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ABSTRACT 


The  Air  Force  Office  of  Scientific  Research  has  established,  with  major  three-year  fundin;,  a  Center  of 
Excellence  at  Stanford  University  to  develop  new  technolopes  that  will  be  key  to  advancing  automation  of 
manufacturing  processes.  The  new  Center  draws  from  two  well-established  research  groups  at  Stanford:  the 
Artificial  Intelligence  Laboratory's  Robotics  Group,  and  the  Automatic  Control  Group  in  Aeronautics  and 
Astronautics. 

Our  Air  Force  program  focuses  on  the  robotic  aspect  of  automated  manufacturing,  which  draws  upon 
more  of  the  new  technologies,  and  more  deeply,  than  any  other  aspect.  We  believe  the  next  generation  of 
lightweight,  facile,  quick,  seeing,  sensing,  thinking,  reasoning  robots  can  provide  the  future  flexible  automa¬ 
tion  that  will  be  so  important  in  achieving  higher  leveb  of  productivity.  The  needed  underlying  technologies 
fall  into  four  categories:  manipulator  control,  sensing,  thinking,  vision.  We  are  working  to  make  useful 
contributions  in  ail  four  technical  areas,  with  much  interaction  between,  and  syner?'*m  among  us. 

Duiiag  this  leeond  yatjjKigress  has  been  made  on  four  components  of  our  secc  .  generation  intelligent 
system.  SUCCESSOR:  a)  a  geometric  modeling  system,  b)  an  advanced  symbolic  graphics  system,  e)  a  system 
for  matching  structures  from  stereo  pairs  and  motion  sequences,  and  d)  ATLAS,  a  model-based  planning 
system  for  automating  the  planning  of  assemblies.  Developments  of  Common  Lisp  were  made  to  make  our 
programs  portable  and  to  enable  us  to  work  on  several  computers.  These  developments  include:  a)  SLISP. 
a  common  Lisp  subset,  on  VAX;  b)  TAIL,  a  version  of  SLISP  on  SUN  workstations;  c)  a  real-time  garbage 
collection  algorithm  for  Lisp  in  support  of  robotics.  In  addition,  small  development  of  the  AL  programming 
system  continued.  The  Al  Robotics  Lab  n'^ved  tn-May  to  larger  quaiters.  " _ _ 

Development  of  control  systems  for  our  two-link  manipulator  with  flexible  tendons  has  progressed  both 
in  underlying  theory  and  in  hardware  development.  Full  nonlinear  (FORTRAN)  simulation  is  operating,  and 
advanced  concepts  for  multi-input  multi-output  control  are  being  tested.  The  two-link  hardware  has  been 
tuned  and  calibrated.  Initial  control  using  end  point  feedback  has  been  accomplished.  Two  extensive  theo¬ 
retical  studies  of  task  command  strategies  have  been  completed,  and  final  reports  published.  Control  system 
development  for  the  unique  configuration  of  a  fast  wrist  on  the  end  of  a  very  flexible  arm  has  progressed  to 
where  its  utility  in  providing  very-high-speed  capability  within  a  work  station  has  been  demonstrated  in  a 
series  of  pick  and  place  tasks.  We  have  begun  basic  work  in  one  of  the  most  difficult,  and  certainly  one  of 
the  most  important  areas  for  deeply  advancing  robot  manipulator  capability:  adaptive  control. 

This  year  s  effort  on  integrated  tactile  sensors  has  concentrated  on  techniques  for  calibration  of  the 
tactile  arrays  that  are  being  developed,  with  good  implications  for  factory-robot  calibration  procedures  that 
such  techniques  can  facilitate. 

Altogether,  there  are  some  20  graduate  student  research  assistants  and  fellows  involved  in  this  .^ir 
Force  Research  Program. 
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INTRODUCTION 


The  Air  Force  Office  of  Scientific  Research  has  established,  with  major  three-year 
funding,  a  Center  of  Excellence  at  Stanford  University  to  develop  new  technologies  that 
will  be  key  to  advancing  automation  of  manufacturing  processes,  with  specific  Air  Force 
concern  for  assembly,  test,  and  rework.  These  areas  represent  important  economic  leverage 
in  the  affordability  of  Air  Force  systems. 

The  new  Center  draws  from  two  internationally  known  research  groups  at  Stanford; 
the  Robotics  Group  of  Stanford’s  Artificial  Intelligence  Laboratory,  and  the  Automatic 
Control  Group  of  Stanford’s  Department  of  Aeronautics  and  Astronautics.  A  common 
objective  that  we  are  able  to  address  together,  with  this  major  Air  Force  support,  is  to  ad¬ 
vance  the  effectiveness  of  automation  in  manufacturing  by  mounting  research  concurrently 
—  and  synergistically  —  into  a  set  of  the  primary,  pacing  technologies  in  automation,  as 
we  outline  below. 

Our  Center  —  the  Center  for  Automation  and  Manufacturing  Science  (CAMS)  —  is 
the  first  of  a  new  complex  of  centers  at  Stanford  involved  in  the  manufacturing  enterprise: 
the  Stanford  Institute  for  Manufacturing  and  Automation  (SIMAj.  The  other  founding 
Centers  are  CTRIMS,  for  graduate  education  in  manufacturing  operations,  the  Center  for 
Design  Research  (CDR)  which  pursues  creative  use  of  the  computer  aided  prototyping 
process  and  the  Center  for  Metals  Formability.  We  will  interact  in  many  ways  with  other 
centers  at  Stanford,  such  as  the  Center  for  Materials  Research  and  the  large  Center  for 
Integrated  Systems  of  which  Professor  Meindl  (a  principal  investigator  on  this  AFOSR 
Center  of  Excellence  program)  is  Codirector. 

Within  CAMS  we  are  addressing  a  number  of  automation  issues.  For  example,  a 
major  project  for  automation  of  ultra-high-precision  machining  is  now  underway. 

In  our  Air  Force  program  we  have  decided  to  focus  on  robotic  aspects  of  automation. 
With  their  requirements  for  great  flexibility  of  use  and  rapid  task  redirection,  the  robotic 
aspect  of  automated  manufacturing  will  draw  upon  more  of  the  new  technologies,  and 
more  deeply,  than  any  other  aspect. 

If  the  right  set  of  technologies  is  developed,  we  believe  the  next  generation  of  robots 
can  (by  comparison  with  today’s)  be  lightweight,  limber,  deft,  facile,  quick,  friendly,  low- 
powered,  seeing,  sensing,  thinking  machines.  Above  all,  they  will  be  capable  of  reasoning 
and  strategizing  -  of  carrying  out  tasks  assigned  at  a  high  conceptual  level,  by  ‘thinking 
through”  the  best  way  to  carry  out  any  given  task.  Robotic  devices  with  such  charac¬ 
teristics  and  capability  can  provide  the  flexible  automation  that  will  be  so  important  in 
achieving  higher  levels  of  productivity. 

What  are  the  underlying  technologies  that  will  be  needed  as  the  base  for  robots  with 
such  capabilities?  They  can  be  described  in  four  categories;  manipulator  control,  sensing, 
thinking,  vision.  Among  us,  in  our  Center,  we  are  working  to  make  useful  contributions 
in  all  four  technical  areas.  There  is,  of  course,  much  interaction  between,  and  synergism 
among  the  four  areas;  and  that  is  the  exciting  thing  about  the  level  of  effort  that  the 
AFOSR  program  makes  possible.  Specifically,  fast,  precise  manipulator  control  is  the  pri¬ 
mary  focus  of  Task  3  of  the  program,  tactile  sensing  of  Ihsk  4,  and  computer-based  thinking 
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and  vision  of  Task  2.  But  these  depend  upon  each  other  altogether  as  diagrammed  in  Fig, 
3-1,  and  draw  upon  one  another  in  many  ways.  We  feed  back  signals  from  many  sensors 
—  optical  and  eventually  perhaps  acoustic,  as  well  as  tactile  and  force  —  to  effect  good 
end-point  control  of  manipulators.  New,  more  competent  manipulators,  with  their  multi¬ 
ple  sensors,  will  be  utilised  avidly  by  task-management  systems  to  produce  new  assembly 
sequences  that  are  quicker,  more  precise,  and  more  efficient. 

More  acute  robot  vision,  together  with  more  rapid  visual  perception  (scene  analysis), 
are  very  important  basics  for  more  effective  task  planning,  and  may  even  someday  be  used 
in  real  time  by  the  fast  manipulator  controllers  themselves. 

Intelligence  and  sensing  are  important  throughout  advanced  manufacturing  technolo¬ 
gies.  The  Stanford  Artificial  Intelligence  Lab  (SAIL)  has  made  progress  in  our  work  on 
inspection  and  machine  vision,  in  manipulation,  in  mobile  robots  for  warehousing,  and  in 
aspects  of  Computer  Aided  Manufacturing  (CAM).  AI  can  contribute  to  other  areas  of 
manufacturing,  in  design  of  mechanical  parts,  process  planning,  and  cell  control.  Model- 
based  systems  with  geometric  reasoning  contribute  to  all  aspects  of  AI  in  manufacturing. 

During  the  second  year  the  Artificial  Intelligence  effort  shifted  from  robot  program¬ 
ming  systems  to  model-based  intelligent  systems.  Major  components  have  been  imple¬ 
mented  of  our  second  generation  intelligent  system,  SUCCESSOR,  following  our  first  gen¬ 
eration  system,  ACRONYM.  These  components  are:  a)  A  geometric  modeling  system  was 
designed  and  built;  it  provides  a  user  interface  which  simplifies  construction  of  geometric 
models,  capabilities  which  have  proved  to  be  important  in  recognising  industrial  parts; 
c)  A  vision  system  incorporates  matching  of  structures  for  stereo  pairs  and  motion  se¬ 
quences;  d)  ATLAS,  a  model-based  planning  system  is  aimed  at  automating  the  planning 
of  assemblies;  it  was  designed  and  partially  implemented. 

Lisp  is  the  language  of  choice  in  AI.  We  have  chosen  Common  Lisp  as  a  basis  for 
programs  which  are  portable  and  which  enable  us  to  work  on  several  computers.  In  support 
of  implementation  of  intelligent  systems,  SLISP,  a  subset  of  Common  Lisp  was  implemented 
on  VAX  in  FVans  Lisp.  A  version,  TAIL,  was  implemented  on  low  cost  SUN  workstations. 
The  system  may  contribute  to  commercial  implementation  of  Common  Lisp.  In  addition, 
an  algorithm  was  developed  for  real-time  garbage  collection  in  Lisp. 

A  small  effort  has  brought  a  VAX  version  of  the  AL  programming  system  for  robots 
near  completion. 

The  AI  Robotics  Lab  moved  in  May  to  Cedar  Hall.  The  move  has  given  us  adequate 
space  for  research.  Altogether,  the  move  was  bandied  effectively;  the  effort  and  dislocation 
were  reasonable. 

Our  advanced  work  on  the  rapid,  precise  control  of  robotic  manipulators  (refer  again 
to  Fig.  3-1)  is  being  carried  out  in  the  Aerospace  Robotics  Laboratory  of  the  Air  Force 
Center  at  Stanford. 

The  underlying  objective  here  is  to  develop  the  sequence  of  technologies  that  will 
enable  future  generations  of  robots  to  move  much  more  quickly,  more  deftly,  than  today’s 
robots,  achieving  much  higher  levels  of  precision,  while  at  the  same  time  removing  the 
need  for  robots  to  be  the  heavy,  rigid,  power  hungry  machines  that  today’s  robots  are. 


Toward  this  objective,  we  are  pursuing  a  sequence  of  specific  projects,  each  with 
specific  capability  goals  to  be  demonstrated,  that  will  provide  key  elements  of  the  desired 
new  robot  technology  base.  The  AFOSR  Center  of  Excellence  level  of  funding  has  made 
it  possible  for  us  to  make  major  advances  this  year,  both  in  technological  capabilities 
achieved  and  in  the  development  of  experimental  facilities  and  expertise  needed  to  carry 
on  advanced  research  in  this  area. 

During  the  second  year  of  our  Air  Force  funding,  control  system  development  for  the 
unique  configuration  of  a  fast  wrist  on  the  end  of  a  very  flexible  arm  has  progressed  to 
where  its  utility  in  providing  very  high-speed  capability  within  a  work  station  has  been 
demonstrated  in  a  series  of  pick  and  place  tasks. 

We  believe  that  the  new  capability  for  fast,  precise  control  of  the  position  of  a  gripper 
in  space,  despite  its  mounting  at  the  end  of  a  very  flexible  arm,  represents  a  potenti^y 
very  important  advance  for  use  in  the  next  generation  of  robotic  manipulators. 

Development  of  control  systems  for  our  two-link  manipulator  with  flexible  tendons 
has  progressed  both  in  underlying  theory  and  in  hardware  development.  Full  nonlinear 
(FORTRAN)  simulation  is  operating,  and  advanced  concepts  for  multi-input  multi-output 
control  are  being  tested.  The  two-link  hardware  has  been  upgraded,  tuned,  and  the  sensors 
calibrated.  Initial  control  using  end  point  feedback  has  been  acc:mpli3hed. 

Two  extensive  theoretical  studies  of  task  command  strategies  have  been  completed, 
and  final  reports  written.  One  is  on  the  planning  of  minimum-time  dynamic  paths,  and 
the  other  is  on  the  use  of  feed-forward  compensation  to  enhance  speed  and  precision  of 
target  pursuit  in  factory  assembly  operations. 

In  keeping  with  our  committment  to  use  our  AFOSR  support  to  build  the  strongest 
possible  fundamental  technical  base  for  robotics,  we  have  begun  basic  work  in  one  of  the 
most  diflScult,  and  certainly  of  the  most  important  areas  for  advancing  robot  manipulator 
capability:  adaptive  contol.  This  concept  has  been  discussed  and  given  theoretical  atten¬ 
tion  for  some  years;  but  useful  applications  have  been  few  (confined  largely  to  chemical 
processing).  By  focusing  our  work  on  the  specifics  of  robot  dynamics,  we  intend  to  develop 
and  demonstrate  the  contribution  adaptive  control  techniques  can  make. 

Finally,  our  special  work  on  integrated  tactile  sensors  (refer  one  more  time  to 
Fig.  3-1)  has  proceeded  in  the  laboratories  of  Stanford’s  Center  for  Integrated  Systems. 
This  year’s  effort  has  concentrated  on  techniques  for  calibration  of  the  tactile  arrays  that 
are  being  developed,  with  good  implications  for  factory-robot  calibration  procedures  that 
such  techniques  can  facilitate. 

Second-year  progress  of  our  work  in  each  of  these  fundamental  areas  of  robotic  research 
is  reported  in  some  detail  in  the  Technical  Report  Sections  which  follow. 


Technical  Report  on  T^k  1 

SURVEY  OP  KEY  PROBLEMS  AND  TECHNOLOGY  TRANSFER 


This  task  has  two  parts,  namely  technology  transfer,  and  setting  up  continued  techni¬ 
cal  contact  with  industry  personnel  to  bring  industrial  applications  and  requirements  for 
consideration  in  research  and  design  of  systems. 

Substantial  progress  has  been  made  in  both  areas.  SIMA,  the  Stanford  Institute  for 
Manufacturing  and  Automation,  is  now  well-established.  CAMS,  established  under  this 
AFOSR  support,  is  one  of  four  centers  in  SIMA.  Professor  Cannon  has  been  especially 
active  in  organizing  SIMA.  Through  SIMAi  working  relations  are  being  established  with 
technical  staff  and  management  of  a  growing  set  of  major  corporations. 

A  major  collaboration  was  carried  out  under  the  ITA  program  among  Stanford,  SRI, 
Adept  Tedinology,  and  Honeywell  Incorporated.  The  program  was  funded  by  DARPA  and 
the  Air  Force,  but  a  part  was  supported  by  this  contract.  The  contract  has  had  some  very 
real  technology  transfer.  Stanford  force  control  technology  was  extensively  transferred 
to  Adept.  Our  older,  more  established  force  control  algorithm,  the  Salisbury  stiffness 
control,  was  taken  to  Adept  in  the  form  of  an  existing  program  A  PhD  from  SAIL  worked 
in  bringing  it  up  on  their  own  multiprocessor  system.  Elxtensive  contact  continues  on 
force  control,  especially  for  our  newer  system,  Khatib’s  Cartesian  force  control  system. 
It  is  likely  that  technology  transfer  will  continue  for  quite  some  time  in  the  area  of  force 
control.  A  Stanford  design  for  force  sensing  fingers  which  measure  three  components  of 
force  was  taken  by  Adept  which  went  on  to  modify  the  design  to  measure  an  additional 
component  of  torque  to  enable  full  six  component  force/torque  measurement  from  a  pair 
of  fingers.  They  also  modified  the  design  for  manufacturability.  Also  under  ITA,  one  of 
our  former  students,  Cregg  Cowan,  has  gone  to  SRI  where  he  brings  them  capability  with 
ACRONYM  and  intelligent  systems. 

The  Lisp  developments  supported  by  this  contract  have  already  begun  to  have  some 
influence  on  commercial  Lisp  development.  This  is  the  best  possible  form  of  transfer,  to 
a  product,  in  this  case  Common  Lisp.  SLISP,  the  Common  Lisp  subset  developed  for  our 
work,  has  been  used  by  AI&DS,  a  local  AI  company. 

A  major  disappointment  was  the  failure  of  efforts  to  bring  about  a  commercial  version 
of  AL,  the  programming  system  for  robots.  Even  though  versions  of  AL  were  built  at 
Karlsruhe,  Germany,  Grenoble,  France,  and  University  of  Tokyo,  even  though  the  version 
from  Grenoble  was  commercialized  and  is  used  on  the  SEMI  robot,  even  though  Hitachi 
Production  Engineering  Research  Lab  has  built  a  similar  system,  and  even  though  AL 
has  had  a  very  strong  effect  on  Japanese  efforts  for  robot  programming,  there  has  been 
relatively  little  support  available  in  the  US. 
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Technical  Report  on  Taak  2 

INTELLIGENT  SYSTEMS  FOR  MANUFACTURING; 
INSPECTION  AND  VISION;  SENSOR-BASED  PROGRAMMING  SYSTEMS 


Overview 

During  the  past  year  the  AI  effort  shifted  to  focus  almost  entirely  on  model-based 
intelligent  systems.  In  the  past  the  Stanford  Artificial  Intelligence  Lab  (SAIL)  developed 
the  ACRONYM  intelligent  system.  In  the  Intelligent  Thsk  Automation  project  (ITA)  with 
support  from  DARPA  and  Air  Force,  we  accomplished  the  following:  1)  made  major  exten¬ 
sions  to  ACRONYM;  2)  demonstrated  success  in  modeling  industrial  parts,  in  predicting 
their  appearance,  and  in  identifying  them;  3)  detemained  requirements  for  future  intelligent 
systenas  for  inspection  and  vision. 

Several  sections  below  describe  implementation  of  major  components  of  uur  second 
generation  intelligent  system,  SUCCESSOR.  The  first  section  describes  an  advanced  sym¬ 
bolic  graphics  system  which  was  designed  and  partially  implemented.  It  will  support  very 
powerful  geometric  models.  Several  desired  capabilities  for  ITA  will  be  made  possible 
by  this  system.  Another  section  describes  a  system  fcr  constructing  geometric  models 
which  was  designed  and  built.  It  provides  a  user  interface  which  largely  meets  the  goals 
of  learning  to  use  the  system  in  one  hour  and  building  models  in  fifteen  minutes. 

Another  section  describes  ASTERIX,  a  subsystem  which  incorporates  matching  of 
structures  of  features  for  stereo  pairs  and  motion  sequences.  It  determines  a  strategy 
for  ordering  the  matching  process  for  clusters  of  features.  A  section  describes  ATLAS,  a 
model-based  planning  system  aimed  at  automating  the  planning  of  assemblies.  A  subset 
was  designed  and  partially  implemented. 

A  final  section  describes  Lisp  system  support  for  intelligent  systenos.  We  have  used 
SLISP  in  much  of  our  work.  It  is  a  Common  Lisp  subset  designed  and  implemented  under 
this  support. 

A  small  effort  has  brought  a  VAX  version  of  the  AL  programming  system  for  robots 
near  completion. 

a.  Intelligent  Systems  for  Inspection  and  Vision 

1.  Graphics  and  Prediction  from  Models 
Symbolic  display  of  generalized  cylinders 

A  symbolic  display  system  has  been  designed  and  partially  implemented.  It  generates 
a  projection  of  visible  surfaces  of  a  very  general  subclass  of  generalized  cylinders.  The 
system  is  described  in  Appendix  D.  Conceptually  it  can  be  thought  of  as  ray  tracing,  i.e. 
projecting  back  rays  from  each  pixel  to  intersect  objects,  ordering  intersections  of  surfaces 
along  each  ray  by  distance  from  the  image.  However,  that  can  be  improved  on;  it  is  wasteful 
to  order  surfaces  along  each  ray,  since  order  relations  change  only  along  boundaries,  a  one¬ 
dimensional  subset  of  rays.  In  fact,  depth  relations  change  only  at  T  vertices  and  cusps,  a 
zero-dimensional  subset  of  rays.  This  enables  a  striking  decrease  in  computation  in  depth 
ordering  of  surfaces  for  hidden  surface  calculations. 
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Limbs  of  generalized  cylinders  are  obtained  by  an  iterative  search  stepwise  along  the 
surface.  Surfaces  are  specified  by  spine,  cross  section,  and  sweeping  rule,  each  of  which 
may  be  an  arbitary  function  of  one  parameter  which  is  evaluated  at  each  step.  Steps  are 
chosen  according  to  a  uniform  quality  criterion.  The  step  distance  was  chosen  to  give  a 
constant  number  of  iterations  per  step.  About  100  steps  were  required  for  a  three  turn 
helix.  Objects  are  defined  by  unions,  intersections,  and  set  differences  of  these  primitive 
volumes  or  surfaces. 

Projections  of  surfaces  are  put  into  an  image  quad-tree  from  which  surface  ordering 
is  obtained.  T-junctions  are  found  here. 

The  system  has  generated  hidden  surface  views  of  complex  parts,  but  the  full  system 
for  structured  objects  is  still  being  implemented. 

fVom  this  research  has  come  an  approach  to  determining  the  locus  of  points  at  which 
the  qualitative  structure  of  projections  changes.  This  may  lead  to  compact  prediction  of 
image  appearance  for  complex  objects. 

Building  Geometric  Models 

Appendix  E  describes  a  system  for  building  geometric  models.  The  geometric  model¬ 
ing  system  has  a  user  interface  which  relies  on  commands  invoked  from  menus  and  selected 
with  voice  input.  The  keyboard  is  used  for  naming  elements.  Geometric  forms  are  specified 
by  points  which  are  entered  by  pointing  devices,  in  this  case  a  trackball.  Points  are  three 
dimensional  points  determined  from  stereo  pairs  of  pictures.  Generalized  cylinders  are 
specified  by  cross  section,  spine,  and  sweeping  rule.  Cross  sections  can  be  specified  by  a 
few  points,  e.g.  three  points  for  a  circle  or  rectangle.  For  the  class  of  generalized  cylinders 
with  straight  spine  and  constant  sweeping  rule,  only  two  cross  sections  are  required.  For 
some  simple  cross  sections,  a  total  of  only  four  points  are  required  for  an  object.  For  com¬ 
plex  parts,  still  relatively  few  points  are  required,  of  order  ten  points.  Parts  can  be  defined 
from  others  by  symmetry.  A  model  of  a  simple  object  with  a  few  parts  can  be  built  in 
10  minutes.  The  system  writes  out  a  textual  model  of  the  part.  It  also  determines  cbject 
classes  by  generalization  of  constraints  which  determine  object  classes  in  ACRONYM. 

2.  ASTERDC:  Stereo  Matching  and  Optical  Range  Sensing 

In  Appendix  F,  Triendl  describes  a  system  for  making  correspondence  between  im¬ 
age  structures  in  stereo  pairs  and  motion  sequences.  Constraints  in  correspondence  are 
maintained  as  separate  knowledge  sources  which  can  change  dynamically  according  Ic 
knowledge  acquired  in  operation.  Comers  and  curvet  are  the  features  used  in  the  system. 
It  analyzes  structures  or  constellations  of  these  features  in  each  image  and  plana  a  match¬ 
ing  sequence  which  is  chosen  to  be  effective  for  the  image.  It  classifies  comers  formed  by 
curves,  particularly  to  relax  constraints  on  T-junctions  which  indicate  occlusion  and  for 
which  no  correspondence  is  expected.  The  system  groups  features  into  similarity  classes 
which  might  be  ambiguous  under  the  local  matching  operation.  For  example,  for  a  checker 
board,  interior  comers  are  all  similar,  while  comers  at  the  four  comers  of  the  checker  board 
are  unique.  The  system  begins  by  matching  unique  features.  Comers  connected  to  them 
are  then  unique.  Matching  takes  place  between  classes  of  features,  rather  than  individual 
features.  Matching  has  been  tested  on  several  images  and  on  artificial  data. 
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Appendix  G  describes  the  analysis  of  ranging  methods  to  derive  a  quantitative  com¬ 
parison  of  several  methods  for  measuring  range:  a)  structured  light;  b)  triangulation  using 
a  laser  diode  and  position  sensitive  detector;  c)  time  of  flight  by  phase  measurement  of  a 
modulated  laser  source. 

Appendbc  H  describes  a  method  for  approximate  Gaussian  convolution  by  an  algo¬ 
rithm  which  is  suitable  for  implementation  in  simple,  high  speed  hardware. 

b.  Intelligent  Programming  Systems  for  Robots  and  Manufacturing:  Experi¬ 
ments  with  Ixnplemcntion  of  Atlas 

In  [Brooks  and  Losano- Peres  83]  we  proposed  a  new  approach  to  task-level  robot  pro¬ 
gramming.  Task-level  programming  attempts  to  simplify  the  robot  programming  process 
by  requiring  that  the  user  specify  only  goals  for  the  physical  relationships  among  objects, 
rather  than  the  motions  of  the  robot  needed  to  achieve  those  goals.  A  task-level  specifica¬ 
tion  is  meant  to  be  completely  robot-independent;  no  positions  or  paths  that  depend  on  the 
robot  geometry  or  kinematics  are  specified  by  the  user.  Appendix  I  describes  experimental 
implementation  of  a  part  of  ATLAS. 

We  implemented  parts  of  the  ATLAS  system  (designed  in  the  aoove  referenced  paper); 
Automatic  Task  Level  Assembly  Synthesizer.  There  were  two  aspects  to  this  implementa¬ 
tion; 

•  Implementation  of  planning  submodules. 

•  Integration  of  the  submodules. 

We  took  two  target  assemblies;  bolting  a  lid  on  a  box,  and  inserting  and  bolting  an 
internal  bracket  on  a  floppy  disk  drive 

The  planning  submodules  we  used  were 

•  A  CAD-like  modelling  system  based  on  pt'isms,  which  included  tolerance  information. 

•  A  2  finger  grasp  planner  (based  on  [Laugier  81]). 

•  A  symbolic  constraint  system  (based  on  [Brooks  81|). 

•  A  goal  state  specification  module. 

These  modules  were  partially  integrated  by  using  a  plan  skeleton  matcher.  A  series 
of  intermediate  goals  specified  by  the  user  was  automatically  turned  into  a  sequence  of 
partially  specified  plans  to  be  fed  to  the  above  specialized  planners.  This  integration  high¬ 
lighted  problems  with  using  complex  algebraic  constraints  as  a  communiction  mechanism. 

We  have  not  yet  achieved  full  synthesis  of  our  target  plans. 

The  results  of  the  integration  attempt  have  led  us  to  consider  new  bounding  primitives 
for  a  geometric  based  constraint  system. 

c.  Lisp  System  Support  for  A I 

In  developing  major  software  systems,  it  is  important  to  plan  for  computer  portability. 
The  hardware  available  will  change  rapidly  and  may  have  revolutionary  changes  over  the 
life  of  the  system.  We  have  chosen  to  develop  software  in  a  subset  of  Common  Lisp. 
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Lisp  system  development  has  been  directed  by  Prof.  Brooks.  This  section  describes;  I. 
implementation  of  a  Common  Lisp  subset;  and  11. 

1.  Common  Lisp  subset 

A  subset  of  Conunon  Lisp,  SLISP,  was  defined  and  implemented  in  Frans  Lisp  on 
VAX  systems.  A  version,  called  TAIL,  was  implemented  for  SUN  workstations  under  the 
V  kernel. 

Common  Lisp  [Steele  84]  has  been  adopted  by  DARPA  as  the  standard  language  for 
Artificial  Intelligence.  There  are  a  few  implementations  of  Common  Lisp  underway  for 
various  machines,  but  in  1983  there  were  none  for  small  workstations  such  as  the  SUN. 
(This  situation  has  radically  changed  as  a  result  of  our  work.  At  least  three  companies  that 
we  know  of,  namely  fVans  Inc.,  Lucid  Inc.,  and  Gold  Hill  Computer  have  been  inspired 
by  our  work  to  seriously  pursue  Common  Lisp  on  68000  based  machines.)  The  only  other 
Lisp  for  a  SUN-class  workstation  is  FVans  Lisp.  Fkans  has  a  simple  compiler,  an  inefficient 
function  call  mechanism,  and  poor  performance  on  numeric  computations. 

TAIL  is  a  very  efficient  Lisp  with  an  efficiency  profile  tailored  towards  robotics  appli¬ 
cations. 

The  implementation  is  almost  complete.  We  have  a  Lisp  with: 

•  a  novel,  highly  optimising  compiler. 

•  an  assembler. 

•  a  Common  Lisp  stream-based  I/O  system. 

•  an  interpreter. 

•  a  subset  of  Common  Lisp  functions. 

•  a  garbage  collector  (copying  compacting). 

•  an  integrated  interface  to  V  kernel  windows. 

The  TAIL  system  provides  a  useable  and  efficient  Common  Lisp  subset  for  Stanford 
researchers  to  base  their  systems  upon. 

Besides  the  utility  aspect  of  the  project  there  were  two  research  aspects  of  the  TAIL 
project: 

1.  Compiler  technology: 

It  was  intended  that  TAIL  would  be  transportable  to  other,  and  new,  architectures 
so  that  a  uniform  environment  could  be  provided  for  robotics  research  in  the  face  of  ever 
changing  hardware. 

This  intent  provided  the  driving  forces  for  the  following  developments: 

a.  The  source  to  source  analysis  and  optimization  of  Lisp  programs  developed  by  [Steele 
1978?]  and  extended  by  [Brooks,  Gabriel  and  Steele  1982j  was  further  refined.  In  the 
TAIL  compiler  there  are  two  source  to  source  phases  followed  by  a  code  generation 
phase.  The  phases  are: 


12 


•  Alpbatize. 

•  Analyze. 

•  Generate. 

1.  Alphatization  carries  out  macro  expansion,  implicit  PROGN  re-introduction,  con¬ 
stant  folding  (in  a  general  manner),  special  binding  analysis,  and  simple  code 
re-ordering. 

2.  Analysis  traces  all  variable,  block  and  tag  references,  annotates  all  data  flow 
within  functions,  carries  out  detailed  side  effects  analysis,  and  does  register  usage 
analysis.  It  produces  a  summary  of  this  analysis  for  the  code  generator.  In 
addition  it  both  introduces  and  eliminates  variables,  removes  value  discarding 
side-effectless  code,  re-orders  evaluation  where  possible  to  aid  register  allocation, 
and  occaasionally  re-invokes  phase  1  when  its  source  to  source  transformations 
have  been  large. 

3.  Generation  is  machine  independent:  see  below. 

b.  Register  allocation  is  done  in  a  machine  independent  way,  based  on  a  register  class 
description  for  a  particular  machine  and  the  register  annotations  in  code  templates 
(see  below).  This  is  carried  out  as  part  of  side  effects  analysis.  When  too  many 
registers  are  required,  a  source  to  source  transformation  of  the  Lisp  code  is  done  in  a 
manner  which  guarantees  fewer  registers  wiU  be  needed. 

c.  A  machine  independent  code  generation  strategy  was  developed.  It  differs  from  earlier 
strategies  in  its  combination  and  extension  of  approaches.  It  defines  a  virtual  machine 
for  control  aspects  of  Lisp  (e.g.  function  call,  returning  multiple  values,  etc.)  which 
is  implemented  as  LAP  macros.  It  uses  code  templates,  annotated  with  memory  and 
register  class  requirements,  to  generate  code  for  data  manipulation  functions  (e.g. 
car,  svref,  string-length  etc.).  The  result  is  that  83%  of  the  compiler  source  code  is 
independent  of  the  target  machine. 

2.  Foreign  Window  Interface. 

TAIL  relies  on  the  V-kemel  window  system  for  its  user  interface.  This  is  in  contrast  to 
the  approach  taken  by  Lisp  Machine  manufactures  who  build  a  new  window  system  within 
their  Lisp,  claiming  that  it  is  necessary  to  get  a  tightly  coupled  interface.  Our  experience 
shows  otherwise.  Our  approach  required  integration  of  foreign  language  function  call, 
and  extensions  to  Common  Lisp  stream  primitives  to  handle  windows.  At  the  Monterey 
Common  Lisp  meeting  in  September  1984,  DARPA  set  up  subcommmittees  to  define 
standards  for  foreign  function  call  and  window  system  in  Common  Lisp. 

n.  Lisp  techniques  for  real-time  control. 

A  traditional  Lisp  system  with  a  stop-and-coUect  garbage  collector  can  only  guarantee 
that  CONS  will  take  no  longer  than  a  worst  case  complete  garbage  collection.  This  can  be 
unacceptable  for  a  program  which  has  even  moderate  real-time  response  requirements  and 
only  a  small  heap  to  collect  (e.g.  a  robot  supervisor,  an  applications  signal  processor,  or  a 
message  switching  node).  It  can  also  be  unacceptable  in  an  interactive  mode  :  "'ecially  on  a 
machine  with  a  large  virtual  address  space  where,  although  infrequent,  garbage  collections 
can  effectively  shut  the  machine  down  for  many  minutes. 
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A  real-time  garbage  collector  runs  concurrently  with  uaer  Lisp  code  collecting  garbage 
so  that  there  is  always  free  storage  available  to  the  user  program  —  effectively  providing 
j  fgl^tively  small  bound  on  the  time  necessary  for  CONS. 

There  are  two  major  classes  of  proposals  for  real-time  garbage  collectors. 

One  class  uses  parallel  processors  [Steele  75]  with  at  least  one  for  the  garbage  collection 
process,  and  one  for  the  user  process.  They  make  use  of  special  hardware  to  provide 
synchronization  on  access  to  pointers.  The  garbage  collection  algorithm  consists  of  three 
phases:  mark,  cweep,  and  relocate.  If  the  two  processors  were  to  be  simulated  on  a 
single  processor  the  synchronization  primitives  would  be  unnecessary,  but  there  is  still  an 
extremely  large  overhead  on  stock  hardware  in  having  the  standard  Lisp  primitives  (e.g. 
CAR,  CDR,  RPLACA,  RPLACD,  and  EQ)  check  on  the  phase  of  the  garbage  collector. 
We  are  unaware  of  any  such  garbage  collectors  (parallel  or  serial)  having  been  built. 

The  second  class  [Baker  78]  is  more  inherently  serial.  Lisp  primitives  occasionally  call 
on  the  garbage  collector  to  run  for  a  bounded  amount  of  time.  The  collector  has  only 
two  phases:  sweeping  which  is  done  in  chunks  at  the  invitation  of  the  user  process,  via 
Lisp  primitives,  and  flipping  which  takes  a  bounded  amount  of  time,  during  one  of  the 
sweep  chunks.  Such  algorithms  have  been  implemented,  but  they  all  use  special  purpose 
hardware  and  micro-coded  primitives  to  achieve  moderate  performance.  The  performance 
costs  of  implementing  them  on  stock  hardware  seems  extremely  high.  ‘Stock  hardware* 
refers  to  common  modem  architectures  for  Von  Neumann  uni-processors  (e.g.  MC68000, 
IBM370,  VAX,  NS32032,  etc.). 

We  analyzed  the  above  problems  and  [Brooks  84)  proposed  a  new  storage  layout  for 
all  heap  allocated  Lisp/  objects  which  makes  implementation  of  a  Baker-style  real-time 
garbage  collector  look  much  more  attractive  on  stock  hardware.  It  looks  attractive  enough 
to  be  practical  in  a  wide  range  of  cases,  discussed  below  in  section  3.  The  storage  scheme 
might  have  beneficial  eflfects  for  micro-coded  machines  also. 

We  first  showed  that  copying  compacting  real-time  garbage  collection  algorithms  do 
not  always  need  to  protect  user  programs  from  seeing  uncopied  data,  so  long  as  a  slightly 
more  complicated  collection  termination  condition  is  used.  This  opens  the  way  to  adding 
an  indirection  pointer  to  all  Lisp  heap  objects  making  it  unnecessary  to  check  the  garbage 
collection  status  of  pointers,  and  so  the  overhead  costs  for  most  primitives  reduce  to  the 
addition  of  a  single  instruction.  Impure  primitives,  i.e.  those  which  write  into  existing 
structures  (e.g.  RPLACD),  have  their  overhead  reduced  by  a  factor  of  almost  2.  Code 
density  is  correspondingly  decreased.  The  cost  of  this  scheme  is  increased  storage  size 
for  all  Lisp  heap  objects— one  extra  pointer  per  object,  although  for  some  objects  (e.g. 
floating  point  numbers)  this  expense  is  already  necessary  in  many  other  non  real-time 
garbage  collection  algorithms. 

We  carried  out  a  quantitive  analysis  [Brooks  1984]  of  the  effects  on  code  density  and 
primitive  runtime  for  a  68000  based  Lisp.  We  did  not  carry  out  any  implementation 
experiments.  Such  experiments  would  be  necessary  to  fully  validate  the  approach  and  its 
constant  factor  real-time  cost. 
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Technical  Update  on  l^k  3 

RAPID,  PRECISE  CONTROL  OP  NONRIGID  MANIPULATORS 


Overview 

The  underlying  objective  here  is  to  develop  the  sequence  of  technologies  that  will 
enable  future  generations  of  robots  to  move  much  more  quickly,  more  deftly,  than  today’s 
robots,  achieving  much  higher  levels  of  precision,  while  at  the  same  time  removing  the 
need  for  robots  to  be  the  heavy,  rigid,  power  hungry  machines  that  today’s  robots  are. 

Toward  this  objective,  we  are  pursuing  a  sequence  of  specific  projects,  each  with 
specific  capability  goals  to  be  demonstrated,  that  will  provide  key  elements  of  the  desired 
new  robot  technology  base.  The  AFOSR  Center  of  Elxcellence  level  of  funding  has  made 
it  possible  for  us  to  make  major  advances  this  year,  both  in  technological  capabilities 
achieved  and  in  the  development  of  experimental  faurillties  and  expertise  needed  to  carry 
on  advanced  research  in  this  area. 

The  flow  and  interaction  of  our  projects  is  indicated  by  Fig.  3*1  f which  is  repeated 
for  convenience  from  Reference  2),  where  the  AFOSR-funded  portion  our  research  is 
shaded  blue.  Our  most  basic  work  is  done  under  our  AFOSR  support;  in  a  real  sense  our 
other  work  —  on  robot  task-related  technology  for  DARPA  and  on  manipulators  in  space 
for  NASA,  —  as  well  as  for  industrial  robot  designers,  derives  from  the  series  of  basic 
capabilities  we  are  able  to  develop  with  our  AFOSR  support. 

In  that  sense,  our  primary  current  experimental  facilities  are  the  two-link  arm  with 
flexible  tendons,  with  which  v/e  are  developing  the  capability  for  fast,  precise  control  in 
two  dimensions  using  end  point  sensing,  and  the  very  flexible  arm  with  a  quick  wrist  at 
its  end,  with  which  we  are  advancing  the  ability  for  very  quick  local  task  performance. 
This  year’s  progress  in  these  two  central  areas  is  described  below.  It  will  be  seen  that  the 
program  of  research  with  the  two-link  arm  is  about  on  the  (approximate)  schedule  of  Fig. 
3-1,  while  the  quick-wrist  research  is  about  one-half  year  ahead  of  schedule. 

We  have  also  completed,  this  year,  two  theoretical  and  simulation  studies  into  robot 
manipulation  strategies  ("moving-object  catch  strategy”  in  Fig.  3-1),  which  culminated  in 
Ph.O.  theses  as  reported  below. 

We  have  started,  this  year,  upon  the  long-term  and  quite  pervasive  program  in  adap¬ 
tive  control  of  robot  manipulators  that  is  indicated  beginning  at  the  top  center  of  Fig. 
3-1.  This  will  provide  an  important  new  technology  base  for  much  of  our  specific  future 
reseau-ch  projects,  as  Fig.  3-1  indicates. 
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a.  Fast  Wrist  on  a  Flexible  Arm 


This  section  continues  Section  3(a)  of  Ref.  2,  pp  32-37,  on  the  research  led  by  Wen- Wei 
Chiang. 

Ntw  Progress 

In  addition  to  the  fast  controller  for  the  wrist  motion  described  in  Ref.  2,  fast  con¬ 
trollers  for  the  flexible  arm  have  now  also  been  designed  and  tested.  The  fast  controllers 
for  the  flexible  arm  use  a  state  estimator  and  state  feedback  to  achieve  high  performance. 

The  wrist-beam  system  was  tested  with  its  wrist  loop  closed  in  order  to  determine  the 
system  dynamics  when  the  hub  motor  is  used  to  control  the  motion  of  the  flexible  arm. 
Two  different  system  conditions  were  tested,  and  a  total  of  three  controllers  have  been 
designed  for  them. 

Here,  the  first  system  condition  is  that  the  tip  is  within  the  field  of  view  of  the  optical 
sensor  and  near  the  target  position,  the  wrist  motor  loop  uses  the  wrist-tip  position  sensor 
for  feedback  control,  and  the  wrist-axis  RVDT  is  used  for  the  state  estimator  of  the  flexible- 
beam  controller.  One  controller  was  designed  for  this  system  condition. 

The  second  system  condition  is  that  the  tip  is  far  from  the  target  position.  In  this 
case,  the  wrist  is  regulated  to  a  fixed  wrist  angle  using  the  wrist-axis  RVDT  sensor.  The 
wrist-tip  may  be  either  inside  or  outside  the  field  of  view  of  the  photo  sensor  in  this 
condition.  The  wrist-tip-position  sensor  signal  can  be  used  for  the  control  of  the  flexible 
arm  when  inside  the  field  of  view;  otherwise,  the  hub  potentiometer  of  the  flexible  arm 
will  be  required.  Two  different  controllers  were  designed  for  second  system  condition,  one 
uses  the  wrist-tip  position  sensor  and  the  other  one  uses  the  hub  potentiometer. 

Derived  rate  information  obtained  from  the  hub  potentiometer  is  also  used  in  all  three 
different  controller  designs.  Using  the  hub  rate  information  for  the  control  of  the  flexible 
beam  has  the  advantage  of  higher  loop  gain,  as  indicated  in  the  earlier  study  for  the  control 
of  a  one-link  flexible  arm. 

An  electronic  circuit  was  built  recently  to  process  the  wrist-tip-position  sensor  signal, 
and  obtain  its  rate  information  for  better  control.  Larger  damping  was  achieved  in  the 
wrist-tip  position  control,  and  overshoots  were  eliminated  since  the  more  powerful  position- 
plus-rate  feedback  could  be  used  in  place  of  the  lead  compensation  on  the  position  feedback 
alone. 

A  numerical  analysis  has  been  conducted  to  gain  more  understanding  of  this  behavior 
of  such  a  wrist-beam  system.  The  rigid  wrist  was  assumed  very  heavy,  about  half  the 
weight  of  the  flexible  beam,  so  that  the  interaction  between  the  wrist-tip  motion  and 
the  structural  flexibility  became  larger.  This  assumption  made  the  analysis  more  general 
because  a  large  actuator  may  be  required  for  a  mini-manipulator  to  handle  heavy  loads. 
This  numerical  analysis  allowed  a  theoretical  study  about  the  ultimate  performance  of  a 
control  system,  because  perfect  linearity  and  perfect  knowledge  about  the  system  dynamics 
could  be  assumed. 

During  the  numerical  analysis,  controllers  were  designed  using  different  methods,  and 
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their  performances  were  compared.  It  was  found  that  the  method  used  in  the  experiment, 
by  first  closing  the  wrist  motor  loop  with  the  end*point  sensor,  behaves  as  well  as  the 
other  methods  such  as  LQG  and  pole- placement  technique;  but  closing  the  wrist  loop  first 
is  believed  to  be  most  robust  (less  sensitive  to  parameter  uncertainty). 

New  Demonstration* 

In  this  second  year,  three  new  demonstrations  were  performed  using  the  new  improve¬ 
ments  and  designs,  and  their  motions  are  recorded  in  the  Figures  3-2,  3-3,  and  3-4: 

1.  Figure  3-2  shows  experimental  fast  motion  of  the  wrist  tip  between  three  nearby  target 
positions,  while  the  flexible  arm  is  controlled  by  a  fast  controller  to  align  itself  with 
the  wrist.  In  the  experiments,  a  gripper  on  the  end  of  the  wrist  is  carrying  out  (with 
high  reliability)  a  “shell-game*  type  of  pick-and-place  demonstration,  which  can  be 
viewed  in  an  available  videotape. 

2.  Figure  3-3  shows  large  slew  motion  of  the  system  from  a  position  outside  the  field 
of  view  of  the  tip-sensor  to  a  position  inside  the  field  of  view.  The  fiexible  arm’s 
controller  switches  from  one  algorithm  to  another,  depending  upon  the  sensor  config¬ 
uration.  The  smoothness  of  the  motion  between  switching  sensors  and/or  algorithms 
depends  upon  the  accuracy  of  the  system  model  dynamics,  the  sensor  linearity,  and 
the  signal  continuity  between  different  sensors  in  their  overlapping  boundary.  For  this 
demonstration  calibration,  against  the  hub  potentiometer,  of  the  tip-position  photo 
sensor  at  the  edge  of  the  field  of  view  was  used  to  ensure  smooth  transition  at  that 
edge. 

3.  Figure  3-4  shows  target  snatch  by  the  wrist  when  the  large  flexible  arm  is  moving 
through  the  target  area  without  stopping.  The  fast  wrist  stops  its  tip  in  space  at  the 
target  position  for  0.2  sec.  to  allow  the  gripper  to  “snatch”  the  target  object,  but 
the  arm  keeps  on  moving.  This  is  another  very  important  capability.  As  humans  we 
do  this  frequently;  but,  so  far  as  we  know,  this  the  first  demonstration  of  a  robot 
manipulator  doing  it,  and  rather  smoothly! 

Some  ripples  at  10  ifs  showed  up  in  the  demonstrations.  The  10  motion  is  the  third 
structural  mode  coupled  with  the  vertical  bending  and  twist  mode.  It  is  neither  within 
the  control  bandwidth  of  the  wrist,  which  was  designed  for  ^.5  Hz,  nor  was  it  modeled  in 
the  controller  design  for  the  flexible  arm.  The  demonstrations  showed  that  the  wrist-tip 
positional  response  behaved  well  within  its  designed  bandwidth. 

Referring  again  to  Ref.  2,  p.  36,  we  have  now  accomplished  tasks  (1)  and  (2)  (first 
year)  and  (3),  (5),  (6),  and  (7)  (second  year)  of  the  goals  laid  out  for  this  part  of  our 
research.  The  remaining  two  tasks,  (4)  and  (8),  and  other  plana  for  the  next  year  are 
described  as  following: 

Future  Plans 

Task  (4),  “Target  tracking  and  tip  velocity  control*  is  planned  to  be  performed  in 
three  parts.  First,  position  and  velocity  commands  for  the  wrist  tip  are  generated  by  the 
control  computer  or  by  an  external  signal  generator,  and  the  system  is  controlled  to  follow 
the  command  signals.  This  test  will  verify  the  bandwidth  and  accuracy  of  the  control 
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system.  No  hardware  modification  is  required,  and  this  part  should  be  done  first. 

Second,  the  static  target-position  identification.  The  positions  of  non-moving  targets 
are  indicated  by  the  same  kind  of  incandescent  lamp  mounted  at  the  wrist-tip.  The  lamps 
will  be  turned  on  one  at  a  time,  and  the  same  photo  sensor  is  used  to  measure  their 
position,  so  that  the  wrist  can  be  brought  to  the  right  place  to  pick  up  targets.  We  have 
started  building  the  equipment  required  for  this  task. 

Third,  the  dynamic  target-position  identification.  The  wrist  can  track  a  moving  target 
if  their  positions  are  measured  simultaneously.  This  task  requires  replacement  of  the 
incandescent  lamp  with  two  sets  of  LEDs,  one  for  the  wrist  and  one  for  the  target.  The 
LEDs  are  modulated  at  different  frequencies  so  that  they  can  be  detected  by  the  same 
photo  sensor  simultaneously.  The  LED  system  will  be  similar  to  that  implemented  in  the 
two-link  arm  system,  and  it  is  also  planned  for  mounting  on  the  new  wrist-arm  system  for 
force  control. 

T^k  (8),  "Contact  Force  Control”  is  planned  to  be  tested  on  a  new  wrist-beam  model. 
The  new  model  incorporates  several  improvements,  including  the  selection  of  a  larger  wrist 
motor,  the  addition  of  a  force  sensor,  and  modulated  LEDs.  Force  control  of  a  flexible 
arm  was  originally  performed  under  DARPA  contract,  and  the  study  of  using  the  wrist  to 
improve  the  performance  in  force  control  will  also  be  partially  supported  by  the  DARPA 
contract. 

We  believe  that  the  new  capability  for  fast,  precise  control  of  the  position  of  a  gripper 
in  space,  despite  its  mounting  at  the  end  of  a  very  flexible  arm,  represents  a  potentially  very 
important  advance  for  use  in  the  next  generation  of  robotic  manipulators.  The  study  of 
this  project  demonstrates  how  a  mini-manipulator,  such  as  a  dextrous  hand  with  multiple 
fingers,  can  be  operated  at  a  bandwidth  higher  than  the  limitation  set  by  the  structural 
flexibility. 

Again,  to  see  this  potential  most  clearly  in  the  industrial  robot  context,  consider  that 
a  typical  industrial  robot  arm  might  be  100  times  stiffer  than  our  demonstration  one,  and 
accordingly  divide  all  the  time  scales  in  Figures  3-2,  3-3,  and  3-4  by  ten! 

A  study  will  be  performed  to  investigate  the  feasibility  of  making  a  two-dimensional 
wrist/mini-manipulator,  and  add  it  to  the  two-link  arm  for  improved  position  and  force 
control  in  two  dimensional  space.  Accurate  position  and  force  control  are  essential  for  the 
project  of  two  cooperating  arms,  which  has  been  proposed  to  DARPA  recently. 
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b.  Two-Link  Manipulator  with  Flejdbla  Tendona 

This  section  continues  Section  3(b)  of  Reference  2,  pp.  37-40,  on  research  led  by 
Michael  Hollars  and  Larry  PfefFer. 

Theoretical  Analysis 

The  two-link  arm  represents  a  significant  increase  in  theoretical  complexity  over  the 
one-link  flexible  arm.  The  complexities  are  introduced  in  two  main  areas.  First,  the  two- 
link  arm  dynamics  or  equations  of  motion  are  highly  non-linear  and  can  NOT  be  trivially 
linearized  as  for  the  one-link  arm  case.  Second,  the  two-link  arm  system  is  inherently 
multi-input,  multi-output  (MIMO),  since  the  dynamics  are  highly  coupled  and  cannot  be 
decoupled  into  smaller  single-input,  multi-output  (SIMO)  systems. 

There  is  one  area  where  the  first  experimental  two-link  arm  has  intentionally  been 
made  simpler  than  the  one-link  experimental  arm:  The  system  flexibility  has  been  dis¬ 
cretely  lumped  in  the  form  of  springs  in  the  drive  train  instead  of  continuously  distributed 
in  the  structure.  Thus,  the  problem  has  been  initially  simplified  in  one  respect  so  that  we 
can  more  easily  absorb  the  new  complexities  of  two  links.  Later  versions  of  the  two-link 
arm  will  include  continuously  flexible  structural  elements. 

The  next  two  paragraphs  outline  the  theoretical  considerations  behind  the  three  com¬ 
plexities  introduced  above. 

The  two-link  arm  dynamics  are  nonlinear  in  three  different  w»/s:  First,  the  inertia  of 
the  arm  as  *seen*  from  the  shoulder  joint  is  a  cosine  function  of  the  elbow  joint  angle.  Thus, 
pulling  the  arm  in  will  decrease  the  overall  arm  inertia  and  system  vibration  frequencies 
will  increase  (since  the  spring  constants  don’t  change).  Second,  there  are  Coriolis  and 
centripetal  accelerations  present  which  are  functions  of  the  square  of  the  link  angular 
velocities.  These  nonlinear  acceleration  terms  are  roughly  the  same  order  of  magnitude  as 
the  linear  acceleration  terms,  and  cannot  be  ignored.  The  third,  major,  nonlinearity  is  the 
large  variation  in  inertia  due  to  large  changes  in  payload  mass. 

These  nonlinear  dynamics  have  always  been  present  on  robotic  systems  built  in  the 
past,  but  could  be  accommodated  in  an  approximate  way  with  little  adverse  impact  on  per¬ 
formance.  The  unique  features  of  our  manipulator,  which  require  meticulous  consideration 
of  these  nonlinearities,  are  the  presence  of  variable  flexible  modes,  the  large  payload-to- 
arm-mass  ratio  (1:1  for  our  arm  compared  to  1:10  for  most  arms),  and  especially  the  use  of 
end-point  sensing.  The  full  nonlinear  equations  of  motion  of  the  two-link  arm  with  flexible 
tendons  is  derived  and  written  as  FORTRAN  simulation  code  in  Appendix  J. 

The  multi-input,  multi-output  (MIMO)  aspect  of  the  two-link  arm  (along  with  the 
quick-wrist  system.  Section  3a)  represents  a  major  step  for  our  robotics  lab.  Most  of 
our  previous  experiments  with  one-link  manipulator  position  and  touch  control  have  been 
single-input,  multi-output  (SIMO)  systems  which  can  be  treated  with  classical  control 
analysis  and  design  techniques  (such  as  Root  Locus,  Bode  and  Nyquist).  There  are  no 
similar  techniques  for  MIMO  systems.  State  space  methodologies  such  as  Linear  Quadratic 
Loss  and  Sandy  Gradient  Search  techniques  must  be  used. 
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Two-Link  Arm  Hardwire 

The  two-link  arm  hardware  hae  been  upgraded  and  “tuned"  over  the  past  year  to 
improve  linearity  in  the  drive  train  and  increase  the  positioning  accuracy.  The  elbow  joint 
was  stiffened  and  self-aligning  bearings  installed  to  eliminate  the  joint  striction  problem 
reported  in  the  last  annual  report.  Low  quality  bearings  located  in  the  rest  of  the  drive 
system  were  replaced  with  higher  quality  bearings,  and  the  drive  shafts  and  joint  supports 
were  remachined  and  reinforced  with  steel  inserts  to  improve  alignment.  Currently,  we 
are  replacing  the  plastic  drive  belts  with  pinned  steel  cables,  because  the  plastic  belts 
introduced  nonlinear  torque  disturbances  and  tended  to  jump  the  gears  under  high  loads. 
The  positioning  accuracy  has  improved  substantially  and  is  now  within  the  1  mm.  accuracy 
originally  planned. 

Other  features  were  added  to  the  two-link  arm  to  improve  its  utility.  A  new  infrared 
LED  driven  end-point  sensor  was  developed  for  use  on  the  two-link  arm  which  does  not 
require  the  use  of  an  isolation  hood.  We  achieved  an  improvement  in  signal-to-noise  ratio 
of  about  40  dB  and  now  have  a  (measured)  positioning  accuracy  of  I  part  in  1000  over 
the  range  of  the  sensor.  Thus,  for  an  area  1  meter  square,  we  get  1  mm.  position  sensing 
accuracy.  We  are  investigating  the  patentability  of  the  sensor.  The  sensor  is  being  modified 
to  be  able  to  track  several  targets  at  once  in  anticipation  of  target  tracking  and  cooperating 
arm  tasks. 

Another  feature  acded  to  the  two-link  arm  was  optical  encoders  on  each  joint.  An 
electronics  board  was  developed  which  can  derive  rate  as  well  as  position  from  the  encoders. 
(This  electronics  board  is  also  being  checked  for  patentability.  Now  that  rate  and  position 
at  each  joint  as  well  as  at  each  motor  can  be  measured,  complete  information  on  the 
dynamic  state  of  the  arm  can  be  directly  measured  as  well  as  estimated. 

A  vertical  axis  (or  Z-axis)  drive  system  was  added  to  the  end  of  the  forearm  to  give 
complete  three  dimensional  positioning  capability.  The  Z-axis  drive  was  designed  to  move 
a  1  kg.  payload  the  full  15  cm.  range  of  travel  in  less  than  2  seconds.  A  pneumatic 
gripper  was  installed  at  the  end  of  the  Z-axis  to  pick  up  payloads  of  up  to  1  kg.  Adjustable 
inertia  disks  were  added  to  the  mOtOr  shafts  to  allow  adjustment  of  the  plant  vibration 
frequencies. 

The  PDF  11/24  computer  hardware  was  upgraded  to  give  us  8  new  digital  to  analog 
converters  for  a  total  of  12,  and  to  give  us  24  new  analog  to  digital  converters  for  a  total 
of  32.  The  digital  i/o  board  has  been  utilized  to  accept  the  optical  encoder  digital  signals 
directly. 


Two-Link  Arm  Software 

The  operating  system  of  the  PDP  11/24  was  upgraded  from  RT-11  V4  to  RT-11 
V5  and  the  fortran  compiler  (our  main  real  time  programming  language)  was  upgraded 
from  DEC  RT-11  Fortran  IV  to  DEC  RT-11  Fortran  77.  This  new  software  speeds  up 
c>ur  real  time  control  programs  by  a  factor  of  two.  Thus,  we  can  test  more  sophisticated 
controllers  running  at  faster  sampling  rates.  Also,  some  networking  software  was  obtained 
that  allows  us  to  upload  and  download  programs,  experimental  data,  and  even  executable 
files  between  the  PDP  11/24  and  the  VAX  11/782  which  runs  most  of  our  control  analysis 
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and  simulation  tools. 

A  basic  library  of  real-time  control  and  robotic  routines  has  been  developed  which 
includes  device  drivers  for  the  sensing  and  actuating  hardware,  manipulator  kinematics 
(the  so-called  “arm  solution”),  and  the  manipulator  Jacobian  (differential  joint/cartesiao 
space  relations).  Other  tools  in  development  include  automatic  sensor  calibration  routines 
and  automatic  system  identification  programs.  Nonlinear  and  linearised  simulations  of  the 
two-link  arm  are  being  written  for  testing  of  new  control  schemes  on  the  VAX  11/782. 
See  Appendix  J  for  an  outline  of  the  derivation  of  the  equations  of  motion  and  simulation 
programs. 

The  most  sophisticated  controller  yet  developed  for  the  two-link  arm  is  one  with 
the  noncoUocated  end-point  sensor  and  the  motor  tachometer  rate  signals  being  fed  back 
through  constant  gains.  This  is  a  classical  successive  loop  closure  design.  Integ^  control 
was  added  to  compensate  for  the  striction  in  the  joints  (which  has  been  substantially 
reduced  by  hardware  improvements). 

Initial  Two-Link  Arm  Controller  Desiqn  Using  End-Point  Sensing 

This  first  control  design  for  the  cicaed-loop  end-roint  control  of  the  two-link  arm  uses 
classical  successive  loop  closure  techniques.  This  design  also  assumes  that  the  two-link 
arm  dynamics  can  be  decoupled  and  linearized  so  that  simple  single-input,  single-output 
design  techniques  can  be  used.  This  is  not  the  optimal  or  final  control  system  design,  but 
does  allow  us  to  test  the  end-point  control  concept  on  the  two-link  arm. 

Assuming  that  each  link  is  decoupled  and  the  flexible  vibration  frequencies  remain 
constant,  successive  rate  and  position  loops  can  be  closed  around  each  joint  motor.  First, 
the  rate  loop  is  closed  around  the  collocated  tachometer  signal  from  the  motor  itself.  This 
gives  the  arm  additional  damping.  Then  the  position  loop  is  closed  using  the  end-point 
measurement. 

The  X-Y  cartesian  position  must  be  transformed  into  joint  coordinates  using  inverse 
kinematics,  the  so-called  ‘arm  solution,”  and  the  differential  X-Y  cartesian  position  error 
signal  miut  be  transformed  to  joint  position  errors  by  the  manipulator  Jacobian.  Addi¬ 
tional  integral  control  to  compensate  for  striction  at  the  motors  and  drive  shafts  was  also 
added. 

The  block  diagram  for  this  controller  is  shown  in  Figure  3-5. 
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e.  Strategics  for  Task  Command  and  Control  of  Two*Link  Manipnlators 

Two  separate,  rather  extensive  contributions  were  made  to  this  area  during  the  year 
by  Bruce  Gardner  and  Avi  Weinreb.  Both  were  sponsored  by  this  AFOSR  Contract,  and 
both  culminated  this  year  in  Ph.D.  theses  which  are  available  as  SUDAAR  Reports,  Refs. 
6  and  7. 

Gardner’s  early  results  were  reported  in  Ref.  2  (pp.  41-46).  An  update  summary  is 
reported  here: 


Strategies  for  Moving  Target  Capture 

An  analytic  design  study  is  conducted  to  demonstrate  circumstances  under  which  the 
inclusion  of  feedforward  compensation  in  a  target-tracking  control  scheme  can  be  expected 
to  offer  significant  performance  gain  (e.g.  enough  to  justify  cost  of  implementation).  In 
particular,  a  target-tracking  controller  design  problem  for  a  mechanical  arm  is  developed 
to  assess  quantitatively  the  capacity  of  feedforward  to  provide  a  quicker,  more  accurate 
tracking  response  over  wide  ranges  of  uncertainty  or  variability  in  ir  t  dynamic  parameters 
of  both  plant  and  target. 

The  Stanford  Aeronautics  and  Astronautics  Department  Robotics  Lab  two-link,  two- 
actuator  mechanical  arm,  inherently  a  system  with  variable  kinematic  and  dynamic  pa¬ 
rameters,  provides  an  appropriate  framework  for  this  study.  Using  recent  developments  in 
the  theory  of  quadratic  synthesis  of  robust,  low-order  •optimal*  controllers,  control  logic 
is  developed  -  both  with  and  without  feedforward  -  that  enables  the  arm  end  point  to 
track  a  physical  target  characterized  in  part  by  periodic  motion  of  variable  or  uncertain 
frequency  and  phase. 

It  is  shown  that,  using  relatively  noise-free  measurements  of  target  position  coordi¬ 
nates  only,  feedforward  compensation  can  be  expected  to  provide  substantial  reductions  in 
tracking  errors  for  given  constraints  on  control  effort,  particularly  when  the  range  of  vari¬ 
ation  in  target  frequency  is  large.  As  noise  levels  in  the  position  measurements  increase, 
the  relative  improvement  in  tracking  accuracy  (for  a  given  level  of  control  effort)  offered 
by  feedforward  decreases.  However,  if  target  rate  coordinates  are  also  measured  and  used 
in  the  feedforward  control  scheme,  the  improvement  is  shown  to  be  considerable  even  for 
fairly  high  noise  levels  in  all  target  measurements. 

Experimental  verification  of  the  predicted  results  contained  herein  is  scheduled  for  the 
near  future. 


Strategies  for  Optimal  Control  with  Multiple  Bounded  Inputs 

Several  aspects  of  optimal  control  of  systems  with  multiple  bounded  inputs  are  con¬ 
sidered. 

A  connection  between  the  structure  of  multi-input  systems  and  the  existence  of  mini¬ 
mum  time  solutions  with  singular  controls  is  identified.  It  is  shown  that  systems  which  are 
decoupled  or  one-way  coupled  may  have  (depending  on  the  boundary  conditions  specified) 
some  singular,  non-unique  control  components  as  part  of  the  minimum-time  solutions. 
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A  new  algorithm,  which  extend*  the  basic  gradient  algorithm  to  optimal  control  prob¬ 
lems  with  bounded  controls  is  presented.  When  necessary,  the  resulting  controls  asym 
totically  use  all  the  available  control  range,  without  violating  the  control  bounds.  Thj 
algorithm  uses  an  adjustable  control  weight  to  enforce  the  control  bounds. 

Using  the  new  algorithm,  the  minimum-time  control  problem  of  a  two-link  robot  arm 
is  solved,  using  an  exact  rigid  body  model  and  bounded  controls.  The  problem  is  solved 
both  for  the  given  end-points  case  and  for  the  new  given-distance/unknown  end-points 
case.  The  solutions  provide  new  insight  into  the  dynamic  characteristics  of  the  robot  arm, 
pertaining  both  to  path  planning  and  design  specifications. 
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d.  Adaptive  Control 


This  section  describes  new  research  that  we  are  starting  which  we  believe  will  allow  us 
to  make  future  contributions  to  robotics  that  will  be  fundamental  and  of  central  importance 
in  the  future.  The  leaders  of  this  research  are  Daniel  Rovner  (an  NSF  Fellow)  and  Michael 
Sidman  (a  Digital  Equipment  Corporation  Fellow). 


Rationaie 

The  development  of  high-performance  control  systems  for  complex,  flexible  mecha¬ 
nisms  such  as  robot  arms  depends  on  the  availability  of  a  good  mathematical  model  for 
the  system  to  be  controlled.  This  presents  difficulties,  since  various  important  parame¬ 
ters  influencing  system  dynamics  may  change  during  the  course  of  system  operation.  An 
obvious  example  is  a  robot  arm  picking  up  a  payload,  the  weight  of  the  payload  can  sig¬ 
nificantly  alter  the  dynamics  of  the  arm.  To  achieve  the  best  possible  performance  from 
the  control  system  for  such  a  mechanism,  it  is  necessary  to  identify  changes  in  significant 
system  parameters  white  the  aystem  ia  in  operation.  The  jdentj£  'd  changes  can  then  be 
used  to  update  the  controller  design,  again  while  the  system  is  in  operation,  in  order  to 
optimize  performance.  This  is  the  essence  of  adaptive  control.  Under  this  Air  Force  fund¬ 
ing  we  have  undertaken  the  development  and  testing  of  such  control  systems  for  physical 
systems  available  in  the  manipulator  research  laboratory. 

Syatem  Description 

As  a  first  step,  we  have  developed  algorithms  for  adaptive  control  of  a  physical  system 
previously  built  for  the  purpose  of  investigating  problems  in  the  control  of  flexible  struc¬ 
tures  with  noncollocated  sensors  and  actuators.  This  system  consists  of  four  steel  discs 
connected  to  a  central  torsion  spring.  RVDT  sensors  measure  the  angular  displacement 
of  each  disc,  and  a  brushless  DC  torque  motor  mounted  on  the  second  disc  from  the  top 
provides  the  control  input.  The  polar  moment  of  inertia  of  two  of  the  discs  can  be  abruptly 
changed  while  the  system  is  being  controlled.  This  is  accomplished  by  making  two  of  the 
discs  in  pieces,  as  a  series  of  concentric  rings.  Lifting  off  rings  in  succession  causes  signif¬ 
icant  and  abrupt  changes  to  occur  in  the  dynamics  of  the  system,  providing  a  good  test 
for  an  adaptive  controller. 


Accompliahmenta 

The  basic  algorithm  we  have  studied  is  the  Self-Tuning- Regulator,  which  consists  of 
an  on-line  identification  scheme  for  measuring  system  parameters  and  a  pole-placement 
algorithm  for  modifying  the  controller  based  on  the  identified  parameters. 

We  have  taken  two  approaches  to  the  identification  problem.  In  the  first  approach,  the 
transfer  function  of  the  system  is  regarded  as  (almost)  completely  unknown,  a  priori.  A 
recursive  least-squares  calculation  is  used  to  fit  a  system  transfer  function  to  data  measured 
during  controller  operation. 
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The  second  approach  regards  the  system  transfer  function  as  being  completely  known 
except  for  the  inertias  of  the  two  afore-mentioned  discs,  which  are  regarded  as  being  free 
to  take  on  a  continuum  of  values.  The  latter  technique  may  have  advantages  in  robustness 
and  speed  of  convergence,  since  it  involves  less  uncertainty  about  the  physical  system. 
However,  the  identification  algorithm  involves  an  algebraically  nonlinear  least-squares  fit. 

Both  algorithms  will  be  evaluated  on  the  four-disc  system,  and  the  experimental 
results  compared,  beginning  in  year  three  just  starting. 
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Technical  Update  on  Tuk  4 
INTEGRATED  TACTILE  SENSORS 


Orerriew 

The  development  of  a  tactile  eeneor  for  robotica  applicatione  haa  progreaaed  in  all 
the  aubtaaka  deacribed  in  the  Flrat  Annual  Report.  In  addition,  the  importance  of  aimple 
and  accurate  calibration  of  the  final  product  haa  been  appreciated.  Thia  appreciation 
haa  led  to  the  deaign  of  a  unique  calibration  procedure  for  the  tactile  aenaor  utilizing 
aelf'calibration  data  produced  by  the  tactile  array  element.  Major  advantagea  of  thia 
calibration  procedure  include  real*time  compenaation  and  calibration  of  the  aenaor  output, 
the  decoupling  of  aenaor  accuracy  and  bandwidth  permitting  both  high  accuracy  and  high 
bandwidth,  direct  telephone-link  calibration  of  the  in-factory  induatriai  robot  by  the  tactile 
aenaor  manufacturer,  and  Inatantaneoua  recalibratlon  of  the  induatriai  robot  by  unakilled 
pereonnel  when  tactile  aenaore  are  exchanged. 

a.  Kaasdncer  Mieromachliiiag 

The  laaer  proceaaing  of  glaaa  and  ailicon  for  the  micropackaging  of  the  tactile  array 
element  haa  been  inveatigated.  CO)  laaer-drilled  viaa  through  a  pyrex  glaaa  wafer  to  a 
metaliaation  pattern  on  a  bonded  alllcon  wafer  are  critical  to  improving  the  long-term 
atability  of  ailicon  preaaure  aenaori.  During  the  Second  Year,  electrical  continuity  for 
electrical  connection  to  the  array  element  without  compromiaing  either  hermeticity  or 
power  conaumption  haa  been  achieved.  Theae  viaa  are  lesa  than  100  mierona  in  diameter 
with  a  contact  reaiatance  of  leaa  than  10  ohma.^ 

b.  Oa  Board  Signal  Proeeaelng 

The  deficienciea  of  the  firat  veraion  of  the  tactile  array  element  on-board  circuit, 
CPT3A,  were  deacribed  in  the  Firat  Annual  Report.  Since  then  the  effort  on  thia  sub- 
taak  haa  been  to  improve  the  temperature  and  aupply  dependenciea  of  the  circuit.  The 
reviaed  circuit,  CPT3B,  haa  been  deaigned,  aimulated,  laid  out,  fabricated,  and  partially 
tested.  Thia  effort  haa  been  extremely  aucceaaful.  Without  sacrificing  oscillator  stability  of 
230  ppm,  which  corresponds  to  a  dynamic  range  of  more  than  4000,  temperature  depen¬ 
dence  haa  been  reduced  from  ISOO  to  35  ppm/*C.  Thia  accuracy  in  an  integrated  circuit  is 
unprecedented  and  has  been  achieved  pre^ualy  only  by  means  of  thin  film  components 
and  individual  laser  trimming  of  much  larger  and  more  power  consuming  hybrid  circuits. 
In  addition,  the  principal  source  of  aupply  dependence  has  also  been  eliminated,  but  as  of 
this  writing  the  substantial  improvement  expected  in  performance  has  not  been  measured.^ 


e.  Arrsy  Mnltlpleocsr 

T^ia  device,  which  controls  and  multiplexes  the  array  as  described  in  the  Firat  Annual 
Report  continues  in  its  circuit  design  stage.  The  digital  logic  design  of  the  IC  has  been 
completed  and  is  being  verified  using  the  Saloga  logic  simulator.  The  PL  implementation 
of  the  logic  has  been  completed  also.  Currently,  work  is  progressing  on  the  circuit  imple- 
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mentation  of  the  multiplexing  electronici.  For  thla  pnrpoM,  a  modified  fonn  the  the  EFL 
logic  family  being  inveetigated.’ 

d.  Calibraiioa 

Inadequate  calibration  waa  recently  identified  (Open  Oiecueaion,  IEEE  Solid  State 
Sensore  Conference,  Hilton  Head,  SC,  June  6>8,  1984)  aa  one  of  the  two  main  factori  re¬ 
tarding  the  penetration  of  ailicon  aenaori  into  the  commercial  aenaor  market.  Typically, 
commercially  available  ailicon  aenaori  are  uncompenaated  for  temperature  effecta  and  cali¬ 
bration  for  the  senaed  parameter  mnat  be  performed  on-alte  by  akilled  penonnel  employed 
by  the  uaer.  (The  aecond  factor  identified  waa  inadequate  packaging.)  To  solve  this  cali¬ 
bration  problem,  a  novel  calibration  scheme  haa  been  developed  for  the  tactile  sensor.  This 
scheme  utilises  thermal  and  nunufacturing  variability  information  multiplexed  with  the 
pressure  data  in  the  output  of  every  tactile  array  element.  The  scheme  is  simplified  com¬ 
pared  to  the  usual  computational  methods  in  that  it  utilises  a  table  look-up  algorithm  for 
both  calibration  by  the  manufacturer  and  operation  in  the  factory.  This  algorithm  requires 
only  a  uniqueness  relationship  between  tactile  sensors  and  reference  temperature  and  pres¬ 
sure  instruments  in  the  manufacturer’s  calibration  apparatus.  Presaxire  is  never  calculated 
directly  from  the  tactile  sensor  outputs  during  operation.  Instead,  these  outputs  merely 
point  to  reference  instrument  data  stored  during  calibration.  A  major  advantage  of  this 
scheme  is  that  sensor  accuracy  and  bandwidth  are  decoupled.  Both  are  limited  indepen¬ 
dently  only  by  calibration  table  memory  space.  (It  is  to  be  noted  that,  since  semiconductor 
memory  is  annually  becoming  larger  and  less  expensive,  this  is  no  fundamental  limitation.) 
Since  no  computational  algorithm  is  involved  in  measuring  pressure,  the  customary  tradeoff 
between  accuracy  and  computational  time,  that  is,  bandwidth,  is  eliminated.  f\irthennore, 
implementation  of  the  calibration  table  memory  space  in  EEPROM  (electrically  erasable 
programmable  read  only  memory)  permits  tactile  sensor  calibration  data  to  be  transfered 
directly  from  the  manufacturer’s  calibration  laboratory  to  the  in-factory  industrial  robot 
by  telephone  link.  It  also  permits  the  in-factory  robot  to  be  recalibrated  instantaneously 
by  unskilled  personnel  when  tactile  sensors  are  exchanged  (when  operating  pressure  ranges 
are  changed,  for  instance)  simply  by  flipping  a  switch. 

An  automated  apparatus  for  performing  this  calibration  procedure  has  been  designed 
and  the  prices  of  components  obtained.  The  apparatus  combines  state-of-the-art  pressure 
and  temperature  controllers  for  more  accuracy  than  that  achieved  by  calibration  labora¬ 
tories  of  current  silicon  pressure  sensor  manufacturers.  This  high  degree  of  accuracy  will 
enable  us  to  observe  the  effects  of  mechanical,  electrical,  and  packaging  design  changes 
upon  sensor  performance.  It  will  also  reduce  the  cost,  time,  and  skill  required  to  per¬ 
form  the  calibration.  It  is  expected  that  as  the  tactile  sensor  developes  from  prototype 
to  production,  this  apparatus  will  be  expanded  from  a  small-lot  to  a  large-lot  capacity 
so  that  large  dataset  and  throughput  problems  can  be  solved  for  future  tactile  sensor 
manufacturers. 
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GRAPHICS  AND  PREDICTION  FROM  MODELS 


Richard  Scott 


Abstract 

The  Brst  part,  of  this  paper  derives  algorithms  and  complexity  arguments  for  a  mainly  implemented 
symbolic  graphics  scheme  based  on  ray  tracmg  arguments.  The  mjiin  step  converts  the  scene 
dehnition  wto  a  3D  topological  representatiau  as  seen  from  the  viewpoint.  It  starts  with  a  scene 
composed  hy  unions,  intcrscction.i  and  negatives  of  parametcrixed  primitive  volumes.  Then  limbs 
are  found  ou  the  .surfaces  to  given  accuracy,  and  mutually  consistent  T-junctians  and  cusps  are 
found  in  tliiir  projections  to  the  image  plane.  The  surfaces  and  image  planes  arc  represented  by 
quad-trees.  From  these,  the  topology  is  extracted,  represented  by  a  “tooth-pick”  structure  which 
orders  conical  volume  chunks  that  project  into  the  same  area  of  the  image.  The  foremost  regions 
can  be  displayed  for  hidden  siirfatc  graphics.  The  topology  of  limbs  cusps  and  Ts  is  invariant 
over  a  range  of  viewpoints  and  models.  Thus  the  tooth-pick  inodtd  n  he  sed  as  a  framework 
for  predictions.  The  second  part  of  the  paper  e.ranunes  changes  m  the  topology  as  a  function  of 
viewpoint  and  surface  shape,  and  partially  derives  geometrical  representations  for  the  changing 
.set.”  of  predictions. 


Introduction 

The  main  result  of  this  rcjoarch  is  a  near  optimal  and  mostly  implemented  graphics  scheme 
that  kiiowr  qu.ilitativcly  what  it  is  displaying.  A  scene  dchned  by  set  operations  on  parametrized 
General i/.isl  ('ylimlcrs,  is  coiiverti'd  into  a  3D  geoinrtric  representation  as  s<'rn  from  the  viewpoint. 
This  represi  ntatiou  luid  the  method  hy  which  it  is  derived  both  hav>  natural  generalizations  which 
ajjaly.se  and  .support  algorithms  for  further  problems. 

To  put  this  in  a  hroatler  roiitext;  The  overall  goal  is  to  nrognize  objects  in  an  image  or 
iiidiisinal  .x'ttmg.  Tliis  is  doiu-  by  searching  through  the  viewing  spare  .uid  the  space  of  modelled 
obje<  ts  to  HikI  a  match  with  the  inuige.  The  so.urh  should  be  siipportesl  by  geometric  frameworks 
whuli  organize  fh<'  nio<l<  ls  ;uid  flu'ir  rharactcnstic  views.  Then  the  .scarrh  is  guided  through  the 
frameworks  by  fe.ifurcs  (  xrriM  fed  from  the  imag<*  which  are  constant  over  ranges  of  viewpoints  and 
models.  So  ;ui  important  piirt  of  recognition  is  the  job  of  .sttUtiiig  with  a  model  and  then  ileducing 
what  fi-atiires  will  he  quasi-invariant  at  different  n-solutions;  in  other  words  “prediction". 

Pivst  Work,  such  as  AC’RONYM.  has  round  imuiy  useful  predirtioii.s.  eg.  trapezoid  ribbons  and 
•iti  ;u  liiiieiits.  Blit  tlieir  power  is  limited  liy  a  lack  of  gisuiic-tric.il  and  topolngical  structure  in  the 
way  that  the  pretlictioiis  are  rouil>uie<l  luiil  used.  This  is  a  )>rohlem  that  our  reseiurli  liopi's  to 
solve. 

('onsitler  the  function  F,  which  lumps  riigethcr  modeiUng.  prediction  anti  graphics, 

F;  (Objcct-Motlel,  Viewpoint,  Ray-tliru-viewpoiut)  —  Intersections  along  the  ray  with  the 
model. 

F  can  be  decomposed  into  three  levels  of  abstraction,  with  each  level  factoring  out  invariants  to 
bo  usetl  as  input  for  the  level  above. 

1  Symbolir  grapliir.s  funrtinn  G  with  fixed  motlel  and  viewpoint, 

G;  Rny  — »  Ray  intersections 


39 


2.  Prediction  function  P  with  fixed  model, 

P:  Viewpoint  — »  Invariants  of  G 

3.  Deformation  function  D  with  varying  surface  shape, 

D;  Model  — ►  Invariants  of  P 

The  functions  G  and  P  are  a  natural  way  of  factoring  the  intersections  of  a  model  with  the  4D 
spcice  of  arbitrary  rays.  In  all  cases,  a  method  of  gettmg  at  the  invariants  is  to  find  and  represent 
(a)  the  singularities  and  then  (b)  the  contmuous  spaces  in  between. 

1(a)  For  the  function  G  the  singularities  are  limbs  and  cusps  (local)  and  T  occlusion  junctions  (non* 
local).  They  are  derived  iuid  shown  to  give  an  efficient  hidden  surface  scheme  by  a  sequence 
of  complexity  arguments  biksod  on  ray  tracing. 

The  singularities  are  found  using  tliree  main  components.  First  there  is  the  underlying  object 
modelling  system,  which  consists  of  unions,  intersections  and  negatives  of  the  parametrized  prim¬ 
itive  volumes.  The  primitives  are  functionally  defined  Generalized  Cylinders.  Surface  coordinate 
patches  of  the  volumes  are  represented  by  quad  trees.  They  are  used  to  store  surface  information 
such  as  the  limbs  and  the  intersection  lines  with  other  surfaces.  This  allows  limbs  to  be  related 
across  surfaces  and  followed  across  different  primitives  volumes.  The  intersoef  on  lines  should  be 
calculated  automatically  but  at  present  they  arc  given  by  hand. 

Secondly,  limbs  and  cusps  are  found.  The  algorithm  repeatedly  extrapolates  a  new  guess  at  a 
limb  point  which  is  Newton-Raphson  iterated  to  within  error  bounds.  The  extrapolation  is  baaed 
on  the  limb  curvature  and  the  step  length  is  chosen  to  make  the  expected  number  of  iterations 
constant  (3  or  4).  This  gives  minimum  solution  time  with  uniform  accuracy;  step  length  varies 
inversely  with  step  angle. 

Thirdly.  T  junctions  arc  found  by  usmg  an  image  plane  quad  tree.  There  is  a  T  junction 
refinement  algorithm  which  can  recover  from  aliasing  errors. 

Ub)  The  singularities  divide  the  surface  into  ipaximal  patches  that  project  (1  — l)and  wliicb  are 
ordered  by  distance  from  the  viewpoint.  The  patches  are  extracted  from  the  surface  quad 
trees  and  must  satisfy  some  simple  Eulcr-like  properties  which  giiaranti'C  physical  ronsistcncy 
This  is  important  bccans<-  the  singularities  are  solved  locally,  approximately  .uid  must  fit 
together  globally.  From  these  a  “tooth-pick^  Rraph  is  extracted.  Each  node  is  a  ronical  chunk 
of  volume  houudctl  .around  the  sides  by  rays  througli  the  viewpoint  and  .it  front  .and  back  by 
I).it<  lies  of  .surface  Tlie  rliiinks  are  lijM'il  up  away  from  the  viewpoint  a.s  if  speared  through  by 
tootli-picks.  The  graph  has  tlie  following  propiTties  which  should  uiak«’  it  a  useful  tool. 

•  V'ii'wpoint  centiTed  information  is  made  explicit.  The  gr.aph  stnicture  is  invariant  over  a  range 
of  vicwiioints  ,uid  luoilel  <leforin.ations;  it  constitutes  a  coarse  level  of  prediction. 

•  It  provides  a  framework  for  storing  otlier  pre<lictions. 

•  The  volume  (  hunks  can  he  formed  by  swis'ping  the  2D  surf.ai  c  patch  from  front  to  hack  along 
the  r.ays.  Tliis  Generalizcil  (ylinder  type  decoinpositiou  enables  geometric  reasoning  between 
different  dimensiouz. 

•  The  inside  ,-uid  outside  of  t'lc  volume  .are  represented  niiifornily. 

•  The  (lerivatioii  is  clean  cut  and  eoimeets  up  to  the  next  level  of  absl  r.’U'l  ioii,  the  fuuctiou  P, 
which  descrilies  how  jiredic  turns  them.selves  can  cliangc. 

One  way  of  f hoiking  of  tliis  is  as  an  .dteniative  modelling  tool  into  which  the  Genrr.alized  Cylin¬ 
der  based  model  definition  can  be  converted  to  mipjiort  p.articiilar  algorithms.  Another  useful 
representation  would  be  something  like  an  oct-tree.  oct-graph,  polyhedron  hybrid. 

2(.a)  The  function  P  has  three  types  of  singularity,  corresponding  to  chnges  in  the  topology  of 
limbs,  cusps  .and  Ts.  ciu  h  of  winch  takes  the  form  of  a  gnierating  line  (L)  on  the  surface  of 
the  modelled  object  witli  a  direction  vector  (V)  in  the  tangent  plane  at  every  point  of  L.  A 
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ray  parallel  to  V  ig  swept  along  L,  forming  a  ruled  surface  which  divides  up  the  viewing  space. 
When  the  viewpoint  crosses  one  of  thew  surfaces  a  node  of  the  tooth-pick  prediction  structure 
changes. 

2(b)  So  the  geometric  framework  for  the  prediction  function  P  will  be  a  graph  of  the  viewing  cells. 
Throughout  each  cell  a  prediction  node  of  the  tooth-pick  graph  is  invariant.  More  work  is 
needed  to  clarify  the  graph  structiu'c  and  the  algorithms  that  produce  it. 

3(a)  The  Deformation  function  D  is  still  in  a  sketchy  state  of  development,  though  some  of  its 
singularities  are  known. 

3(b)  It  has  the  potential  to  provide  a  flexible  modelling  hierachy. 

An  alternative  decomposition  of  the  function  F  may  support  recognitior  ’  sed  on  planar  light 
stripes  instead  of  images. 

R;  Ray  —  Ray  intersections  with  the  model 

R  is  a  combination  of  the  functions  P  and  G;  it  takes  a  fixed  model  and  allows  the  ray  to  vary 
over  the  4D  space  of  arbitrary  rays.  It  can  be  decomposed  analogously  to  G  and  P  to  give  a  wedge 
based  tooth-pick  model. 

The  rest  of  the  paper  is  organized  cis  follows: 

Part  On* 


1.  Singularities  of  the  function  G 

1.1  Define  some  terms 

12  Ray  trawring  complexity  arguments 

1.3  Algorithms  for  G  part  (a) 

1.3.1  Limbs  and  cusps:  search,  follow,  store 

1.3.2  T  jtinctions:  find  and  refine 

1.3.3  Modelling;  3,2.1.0D.  otitline.  details 

2.  Complete  representation  of  the  function  G 

2.1  Tootli-pirk  stnicture:  symbolic  grapliics.  prediction  framework 

2  2  Algorithms  for  G  part  (b) 

2.2  1  Hidth’ii  surface  algorithm 

2.2  2  Lnagc  a<  r>irary  au<l  ili.-splay  n'fincments 

Part  Two 

1.1  Predirfion  singul.arities 

12  Vi<>wiiig  cell  grapli:  aniination,  changing  prcclictions 

2  1  Deforiiifitiou  singularities 

2.2  Defunuatioii  structures 
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Part  On* 


1.  Smgul*nt!M  of  G 

1.1  Oefinitfona 

Some  gcomotrical  terms  are  defiacd. 

A  limb,  also  called  a  contour- generator  is  a  closed  loop  of  points  on  the  surface  being  looked 
at.  where  the  line  of  sight  is  tangent  to  the  surface,  i.e..  pcrpendicul.ar  to  the  surface  normal.  It 
is  directed  so  tliat  the  forward  face  li«'3  on  the  left.  The  limbs  divide  the  surface  into  forward  and 
backward  faring  regions  compared  to  the  eye. 

A  contour  is  the  projection  of  a  hmb  to  the  iinagc  plane. 

A  T-junction  is  a  point  in  the  image  where  two  contours  cross.  There  are  two  different  limb 
points  on  the  same  line  of  sight,  the  one  closer  to  the  viewpoint  occludes  the  other. 

At  a  limb  point,  let  F  be  the  line  of  sight  vector,  L  the  limb  tangent  vector,  and  N  the  outward 
surface  normal.  Doth  F  and  L  he  in  the  surface  tangent  plane. 

If  F  v  L  is  parallel  to  N  then  the  forward  face  is  closer  to  the  eye  than  the  back  face,  giving  an 
outer  hmb  point. 

If  F  V  i  is  anti-parallel  to  N.  the  reverse  is  tnic.  giving  an  inner  hmb  point. 

If  F  V  I.  is  zero  there  is  cusp  pomt.  F  parallel  to  L  means  that  the  tangent  plane  intersects  the 
s'lrfacc  along  F.  which  is  the  dciinition  of  an  a.tymptotic  direction  m  the  surfcice.  So  L  is  parallel 
to  an  asymptotic  direction  in  a  hyper (lolic  (saddle  shaped)  region  of  surface.  This  is  another  way 
of  defining  a  cusp.  There  are  two  types  of  cusp,  with  L  pointing  towards  or  away  from  the  eye. 
Fig.  1  shows  an  oblique  view  of  a  torus. 

1.2  Ray  Tracing  Complexity  Arguments 

Ray  tracing  arguments  give  an  intuitive  derivation  of  the  fact  that  the  only  singularities  of  G  are 
hiiibs  iuid  cusps  (local)  and  T  juiK  tioris  (nonlocid).  which  was  proved  in  1955  hy  Whitney.  The 
sequence  of  arguments  makes  sncc<“ssivc  refinements  to  an  obvious  first  attempt  algorithm,  and 
rlius  sliows  tliat  an  ojitiinal  hidihn  surface  algorithm  must  find  the  singularities. 

If  c  is  rlie  niaxinium  allowed  error  in  the  image.  I  is  tlie  total  length  of  the  limbs,  c  the  total 
l  urv.iture  of  tlie  limbs,  thru  it  ha.s  eoiuplcxity 

0(n log n),  where  n  has  0\/'TcJe. 


First  attempt  algorithm: 

1.  Shoot  out  a  conical  bimrli  of  ray.s  from  thi'  eye.  Calculate  where  they  intersect  the 
surfaces  of  the  obji'ct  being  viewcsl,  and  order  the  intersections  along  each  ray  hy  distance 
from  the  eye. 

.'Mgonthm  1  is  ineflieienl  hiT.'iuse  iieighbouring  rays  (image  points)  have  the  s.iiuc  onlering  of 
siirfiu'es  along  them,  cxcejit  when  an  intiTveniiig  ray  go«-s  through  a  limb  i.e.,  is  tangent  to  the 
surf.ue  there.  So  the  order  of  snrf.u:e  regions  from  the  eye  along  an  arbitrary  ray  can  be  recovered 
from  the  ordering  idong  the  subset  of  hmb  rays. 

2.  Find  the  intersections  of  limb  rays  (tangent  to  some  surface)  with  other  surfaces  in 
their  paths. 

This  is  iiirfiieieiit  because  betweeni  neighbouring  limb  points  the  surface  orderings  can  only  change 
in  two  ways.  When  .ui  interni<’diatc  contour  ray  passes  through  (i)  a  T-juiietion,  (ii)  a  cusp. 
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3.  First  find  the  limb  rays  then  find  the  subset  of  T  junctions  and  cusp  rays  and  the 
intersections  with  other  surfaces  there. 

However,  to  find  the  complete  surface  orderings  along  rays  through  cusp  and  T  points,  it  is  not 
necessary  to  solve  for  the  intersections  and  then  order  them.  Instead,  the  difference  in  surface 
orderings  are  already  known: 

(i)  Over  a  limb,  the  forward  and  backward  facing  regions  are  inserted  together  at  one  position  in 
the  ordering.  For  an  outer  limb  segment,  the  forward  face  comes  before  the  back  face,  while  for  an 
inner  segment,  the  back  face  comes  first. 

(ii)  Over  a  cusp,  the  forward  and  backward  facing  regions,  adjacent  in  the  order,  swap  places. 

(iii)  Over  a  T,  the  two  regions  of  the  other  T  braucJi  insert  themselves. 

This  set  of  differences  C2in  be  solvcil  to  give  complete  surface  orderings  for  each  image  region,  by 
propagatmg  partial  orderings  over  the  image. 

4.  Find  the  singular  rays  at  limbs,  T  junctions  and  cusps,  then  solve  for  the  unique, 
complete  surface  orderings  in  each  image  region  that  satisfy  the  ordering  differences  at 
singular  rays. 

This  is  the  hidden  surface  algorithm,  a  large  part  of  building  up  a  representation  for  the  function 
G.  Still  unspecified  arc  the  details  of 

(i)  how  tlic  limbs,  cusps  and  T  junctions  are  to  be  found. 

(ii)  exactly  what  surface  regions  arc  being  ordered,  (and  ht  w  to  ensure  that  the  Ts  and  cusps  of 
each  region,  solved  locally  to  withm  an  error  bound,  are  giooaily  consutent.) 

(iii)  and  how  to  propagate  up  the  orderings. 

As  far  as  complexity  is  concerned,  (ii)  and  (iii)  arc  both 
0( number  of  image  areas  between  contours) 

wliich  18  a  measure  of  the  scene  complexity,  of  smaller  cost  than  (i). 

Let  e  be  the  maximum  allowed  error  distance  between  the  approximate  and  exact  contours  in 
the  image.  I  be  the  total  length  of  the  limbs,  c  be  the  total  curvature  of  the  limbs,  and  n  be  the 
number  of  limb  rays  solved  for. 

The  average  step  length  between  adjacent  rays  is  1/n.  the  average  step  angle  is  c/n,  and  the 
inferpol.ition  error  is  Ol-^tep-length  x  .step-.uigle)  so.  0(lc/n*)  <  O(t'),  .uid  n  can  be  0{\/lc/e). 

The  cost  of  solving  for  iUl  n  contour  r.iys  is  Ojn).  Tlie  cost  of  Hnding  iMch  cusp  is  0(1);  just 
see  if  till'  hml)  to  niy  angli’  has  rli.ingisl  sign.  To  Hnd  T  junctions,  the  ri  contour  si’gninits  liave 
to  he  te.'.ted  for  inter.section  with  encli  other,  costing  0(n]ogn).  (A.ssiinimg  that  no  tojiological 
inforin.ii loll  i.'i  being  usi'd  to  diri'ct  the  search.) 

Thi.s  results  in  the  complexity  of  .in  uptun.al  liidilcn  surfaie  algorithm.  0(n  log  n),  where  n  is 
(?(v'/c/c), 

Ai  tindly  the  0{n)  limb  solving  dominates. 
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1.3  Algorithnu  for  the  Singularitiee  of  G 


1.3.1  LimlM  end  Cuape 

1.  Search  for  a  point  on  a  new  limb. 

Tbit  is  not  a  time  consuming  step;  the  algorithm  steps  along  a  fixed  parameter  path,  and 
works  out  whether  successive  surface  normals  point  towards  or  away  from  the  eye.  When  they 
point  oppositely,  a  limb  pcasses  between  them.  Has  that  hmb  already  been  solved?  If  so  continue 
searching,  otbcTwise  give  the  two  spanning  points  to  the  following  algorithm. 

2.  Follow  the  limb  over  the  surface,  point  by  point,  until  it  loops  up  with  itself.  This  is  the  most 
expensive  part  of  the  whole  hidden  surface  scheme. 

Each  hmb  point  is  actually  a  pair  of  points  which  spaa  the  hmb  closely.  At  the  end  of  a  partly 
solved  limb  we  know  the  tangent  direction  and  the  previous  step  angles,  (see  fig.  2)  so  an  initial 
guess  to  start  a  new  iteration  for  the  next  iimb  point  can  be  made  by  extrapolating  the  curve  some 
distance.  If  the  step  length  is  too  long,  the  Nowton-Raphson  search  may  not  converge,  if  too  short, 
unnecessary  extra  points  are  found.  It  is  chosen  to  give  the  constant,  optimal  number  of  iterations 
(3  or  4)  that  gets  a  boimding  pair  with  iujglcs  between  their  surface  normals  small  enough  to  give 
an  accurate  estimate  of  hmb  tangent  for  the  next  extrapolation. 

la  other  words,  step  length  d.  and  step  angle  o  along  the  extrapolation  curve  are  chosen  so 
that  d  sin  a  is  constant,  which  makes  the  initial  error  and  number  of  iterations  roughly  constant. 

If  u  and  v  are  the  two  surface  paranicrcrs,  then  the  tangent  direction  in  parameter  space  is, 
du  =  d(N  F)/dv,  dv  =  — d(N  F)/(lu,  where  N  is  the  surface  normal  and  F  is  the  line  of  sight  vector. 
This  and  the  previous  Umb  point  arc  use<l  to  fit  an  extrapolating  spline  to  the  limb  in  parameter 
spiurc  that  has  linearly  changing  curvature. 

For  planar  surfaces  tangent  to  the  line  of  sight,  the  limb  is  taken  along  the  front  edge,  so  that 
the  plane  belongs  to  the  back  facing  region.  To  find  cusps  on  limbs 

chock  for  change  in  sign  of  the  triple  si  alar  product. 


Surface-normal  ■  (Linc-of-sight  V  Limb-tangent) 


1.3.2  T  Occlusion  Junctions 

The  image  is  represented  by  a  quad  tree,  with  clipping  usually  done  around  the  borders  of  the 
imit  square.  When  crossing  contours  are  found  in  a  quad  square,  they  are  initially  refined  until 
the  ordering  at  the  T  is  clear.  The  condition  is  that  both  ends  of  one  segment  must  be  closer  to 
the  eye  than  both  ends  of  the  other. 

Refining  T  junctions 

This  algorithm,  which  refines  T  junctions  to  arbitrary  accuracy,  is  based  on  bisection.  A 
comphc.'ition  is  that  due  to  abasing  errors  the  wrong  bisected  half  may  be  picked  and  the  algorithm 
must  search  back. 

1.  Two  contour  segments  intersect  each  other.  The  longer  contour  is  bisected  (or  a  halfway 
interpolation),  as  an  initial  guess  to  iterate  to  a  new  limb  solution  point.  If  one  of  the  two  new 
halves  crosses  the  shorter  segment,  this  step  can  be  repeated. 

2.  But  what  if  mother  cross  the  shorter  segment?  Then  one  end  of  the  short  segment  must  be 
enclosed  by  the  triangle  formed  by  the  long  segment  and  its  two  halves.  The  contour  at  the  enclosed 
end  is  extended  until  it  exits  the  tnangle  If  it  crosses  one  of  the  halves,  1.  ran  be  resumed.  But 
if  It  crosses  the  long  segment,  then  it  re-enters  the  stack  of  triangles  formed  by  previous  successful 
bisections.  The  contour  continues  being  extended  (step  oy  stepj  chr  :ch  ■  stack,  until  it  exits 
over  a  bisected  side,  and  can  return  to  1.  If  this  never  ..uipcns,  it  -.ally  .ts  out  of  one  of  the 
original  segments  that  formed  a  T  iu  the  quad-tree.  In  that  case  two  quad-tree  Ts  can  be  merged 
away,  see  hg.  5:  they  were  just  an  artifact  of  approximate  solution  methods. 


1.3.3  Modelling:  3,3,1,0D 

Defining  3D  Models 

Scene:  Objcff«  positioned  lu  scene  frame. 

View;  Scone  transformed  into  eye  frame. 

Object:  A  coiiiici  ted  object  is  given  by: 

Priinitive  volume,  or 
D<  formed  aiib-objcct 
(e  g.  rcfli'ctioii.  stretch,  negative),  or 
iiiiioii  of  sub-objects,  or 
iiitersei'tion  of  sub-objccts. 

rniiiitivc  volume  rarainetcrir.cd  volume, 

tliat  IS  pii’ccwisc  continuous 
mid  vliiferentiable. 
e  g  Gi  neralizixl  cylinder, 
half  .sii.-M-e  of  a  pl.vjo. 

This  !.■*  tln'orefirally  equivalent  to  li.ivmg  tlio  whole  scene  surface  p.iraiiieterizi’d  in  a  iimnber  of 
I'oonliiiatc 

liatclies.  Volniiie  models  are  used  Ins  aii.se  they  arc  often  more  compact  and  easier  to  describe. 
Exi-uoples  of  deforiiiAtions; 

One  wing  of  an  aircraft  c.ui  be  modelled  .as  the  reflection  of  the  other.  A  tube  will  be  the  intersection 
of  tlic  outer  eyliiider  with  the  ucgative  of  the  inner  one.  The  deformation  of  objects  can  be  non- 
lini’ar.  E.g.  looking  .at  the  seene  throngii  a  distorting  lens. 

E  g.  Definition  of  a  screw,  formed  by  cutimg  out  the  hchcal  threads. 

(l.’nion  (.srrew-he.atl  h<vul-framc) 

(Intersi'ction  (screw-body  body-fr.ame) 
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(Negative  {screw-threads-hclix  body-frame)))) 


2D  Modelling 

The  image  plane,  and  each  coordinate  patch  of  the  stirfaccs  have  lines  and  regions  represented 

by  quad-trees.  The  lines  are  stored  with  step  length  roughly  proportional  to  Vradius-of-curvature, 

to  give  coustant  accuracy,  as  explained  in  section  3.2  E.  The  discrete  version  of  this  is, 

step-length  a  -  ;  ■  ■*  ,  .  with  a  minimum  length  equal  to  the  allowed  image  error.  The 

y  tin  (stcp-aogle) 

quad  squares  arc  subdivided  until  the  ends  of  a  step  are  in  different  nodes.  Example  of  use: 
Intersections  of  lines  are  found  using  the  quad-trees. 

ID  Modelling 

Lines  are  represented  by  2-way  list  of  knot  points,  containing  curvature  information,  and 
intersections  with  other  lines. 

More  Modelling 

A.  Preprocessing 
0.  Primitive  Volume  Details 
C.  Quad  Trees 

A.  Preprocessing 

Given  an  scene,  object,  or  view  definition,  perhaps  with  a  repeated  sub-object  deformed  in 
different  frames,  the  modelling  system  constructs  an  Object-tree,  with  each  node  describing  a 
separate  object  instance,  and  the  leaves  being  the  primitive  volumes.  The  nodes  provide  a  place  to 
<forc  information  about  each  object  that  vanes  for  different  in.stances.  For  example,  sequences  of 
linrar  transformations  between  coordinate  frames  are  combined,  .\nother  example;  at  the  leaves 
of  tlio  Object-tree  for  a  view,  the  coordinate  patches  .and  limbs  of  the  surface  arc  roprcscutcd. 

There  are  two  more  things  that  the  mudelling  system  dot's  before  it  ctin  be  used  (c.g.  by 
the  srajilucs  progr.'un).  First  it  finds  the  (umiiion  intersection  lines  on  tlie  sufaces  of  intersecting 
objects.  At  present  this  iiiforination  is  given  by  hand.  Then  it  works  out  which  .surface  areas  of 
till-  pnmitive  volumes  of  intersecting  objects  .at  tually  lie  on  the  surface  of  the  composite  object.  It 
uiiplemeiits  the  foniiulAs; 


<?(ou6)  =  ((7an{Ncg6))u(<?f»n(Ncgo)) 
d{(i  n  f>)  =  {On  n  f»)  u  (<?6  n  a) 


where  .Weg  means  nrg.ative  volume,  to  decide  which  sitle  of  e.acli  interscs-tioii  line  is  oii  the  outer 
surf.u-e.  The  inters4rctiun  lines  are  stored  m  the  coordinate  p.itcli  quail-f ri'es  with  the  outer  surface 
oil  (he  left. 

D.  Primitive  VoIurim 

The  basic  building  bloi  ks  are  simple  p.vaincterir.e<I  volumes  Tliry  have  three  ii.iramctcrs, 
(f.s.r)  with  c;mIi  volume  point  P  =  r(f..s,r)  having  unique  p.ar.anietcrs.  OP/dt,  dPjda,  OPjdr 
form  a  right  h.uidt'd  (not  neccss.  ortliogon.'d)  set. 

P  i.s  continuous  in  its  paranu-ters.  and  piecewise  diffi  ri'iitiable.  The  surf.xccs  of  discontinuity 
(called  jump-.iurfncea)  must  be  planar  in  p.ar.amcter  space.  The  purpose  of  this  restriction  is  that 
It  makes  it  e.asy  to  mtt'qxilate  where  a  line  s«'gmciit  in  parameter  space  Iwis  rross«'d  a  jump- 
surface  and  to  work  out  the  rlos<'!*t  junip-surf.ice.  At  pres«  ut  these  surf.aci's  must  be  parallel  to  a 
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p.vamotcr  plane.  To  allow  more  general  volume  discontinuties  and  rurface  edges,  arbitrary  planar 
jump-surfaces  could  be  implemented  using  a  Kd-trce  structure. 

The  bounds  of  the  voltime  are  defined  by  restricting  the  parameters  t,s,aud  r  to  all  lie  in  some 
volume  of  parameter  space,  typically  the  unit  cube.  So  there  is  a  mapping  (position  function  P) 
from  the  unit  cube  of  parameter  space  to  real  coordiu^e  space. 

Opposite  fares  and  edges  of  tlie  cube  can  be  identified  with  each  other,  e.g.  when  one  of  the 
parameters  is  an  angle  in  cylindrical  or  spherical  coordinates. 

The  remaining  faces  of  the  cube  map  onto  the  surface  of  the  volume.  They  have  separate  quad¬ 
tree  representations  where  they  store  special  points,  regions,  and  lines,  such  as  limbs  or  curves  of 
paraboUc  points.  Each  f^c  will  form  a  coordinate  patch  with  one  parameter  fixed,  and  the  other 
two  parameterizing  the  surface.  This  is  true  for  reasonable  paraineterizations. 

So  there  are  two  kinds  of  edges  on  the  volume  surface, 

1.  where  patches  meet. 

2.  where  jump-surfaces  (derivative  discontinuities)  intersect  the  parameter  cube. 

C.  Quad  Trtem 

The  condition  for  spUtting  squares  up  is  that  the  opposite  ends  of  each  line  segment  stored 
lie  in  different  areas.  When  testing  for  crossing  of  diferent  segments,  the  longer  one  is  split  up 
further  to  the  level  of  the  shorter. 

At  the  nodes,  the  segment  end  points  arc  ordered  around  the  borders  of  the  s<iuare.  This 
means  that  n  segments  in  a  square  can  be  tested  for  intersection  with  each  other  in  0(n)  time. 

Also,  regions  of  the  tree  can  be  marked  by  stepping  around  adjacent  squares,  moving  away 
from  the  inside  of  the  directed  border  segments. 


2.  Complete  Representation  of  G 


2.1  Tooth-pick  Structura 

The  volumes  in  the  scene  are  decomposed  into  conical  chunks,  convex  with  respect  to  the  viewpoint, 
which  arc  bounded  around  the  sides  by  limb  rays  and  at  front  and  back  by  regions  of  surface.  The 
connections  of  the  chunks  arc  represented  by  the  ■‘volume  graph" .  Occluding  chunks  can  be  thought 
of  as  being  hned  up  along  tooth-picks  emanating  from  the  eye  and  ending  in  an  area  of  the  image 
plane.  This  is  represented  by  the  'image  graph",  which  links  up  the  smallest  areas  of  the  image 
plane  undivided  by  projected  limbs.  Adjacent  image  areas  have  tooth-picks  which  differ  by  just 
one  conical  chunk. 

The  volume  graph  is  extracted  from  the  surface  and  image  graphs,  where  the  “surface  graph" 
represents  adjacent  regions  of  surface  which  project  (1 — l)to  the  image.  It  in  turn  is  extracted 
from  the  quad-trees  of  the  surface  patches. 

2.2  Algorithms  for  G  part  (b) 

2.2.1  Hidden  Surface  Algorithm 

1.  Split  the  image  plane  up  into  areas  undivided  by  contours.  Each  area  is  bounded  by  a  number 
of  contour  segments  with  Ts  or  projected  cusps  at  the  vertices.  This  is  the  “image  graph* 
extracted  from  the  image  quad-tree.  Since  image  plane  is  not  here  being  used  for  any  distance 
measiiremeuts.  it  might  be  better  to  tliink  of  it  as  a  small  sphere  surrounding  the  viewpoint. 

2.  Split  the  whole  surface  up  into  maximal  regions  that  project  (1— l)to  the  image,  i.e.,  which 
do  not  twist  around  to  hide  themselves.  These  are  sub-regions  of  the  forward  and  back  facing 
areas  bounded  by  limbs.  Thi.s  is  the  'surface  graph". 

3  In  oath  unage  area  order  the  surface  regions  that  project  over  it  by  distance  from  the  eye. 
There  seems  to  be  an  optimal  algorithm  to  do  this  which  for  a  single  object  without  self 
pi’uetratioii  requires  only  the  mforniation  [irovided  by  Steps  1  and  2  (see  below). 

For  hidden  surface  graphics  including  traiisp.arcncy,  the  surface  regions  con  be  displayed  in  order, 
up  to  the  first  opaque  one,  for  each  area  of  the  image. 

Step  Two 

Till'  limbs  divide  tlie  surface  up  into  alternating  forward  .uid  backward  facing  regions  called 
f’lccs  witli  respect  to  the  viewpoint.  Each  face  is  bounded  by  a  .set  of  ilitfermt  limbs  called  a  limb 
set. 

The  only  way  that  a  fare  ( an  occlude  it.sclf  is  by  having  T  junctions  or  cusps  in  its  limb  set. 
If  there  arc  imiir.  then  the  fac<'  proji-cts  jl  — l)to  the  image. 

Ts  and  cu.sps  mean  that  the  fare  needs  to  bi-  split  np  further  to  form  (1  —  1  )sub-regioiis.  The 
'I'litting  .'•Igoritlini  stort.s  witli  .ui  un.'u  rounted  for  T  or  cusp  .and  uses  the  image  graph  to  follow 
ilie  projis  tioii  of  iIk-  limb  over  the  interior  of  the  fare  until  it  re.vbes  another  T  or  rusp. 

There  are  Euler-like  relations  giTveriung  the  pliysie,\lly  possible  eoiiibiii.il  ions  of  Ts  .uid  rusp*. 
They  ( iui  !)<•  derived  l>y  eonsidering  the  ways  that  Ts  and  i  tisps  appear  .uid  disappear  as  the 
viewpoint  moves  .irouiid  (see  Fart  Two).  They  caii  appear,  regroup  and  disappear  m  a  fish-tail  (a 
p.iir  of  cusps  .uid  a  T)  or  as  a  lone  pair.  TIic  test  to  find  nisps  is  local  to  a  small  patch  of  surface, 
and  tlio  T  test  13  IcKol  to  .ui  area  of  the  image.  It  is  import.uil  that  these  local,  approximate 
r.dcuilatioiis  can  he  lombincd  into  a  glob.illy  consistent  linage.  Fig.  5  sliows  two  spurious  T 
jum  tioiis.  Fig.  G  shows  the  T  junction  of  a  fishtail  detected  wifhotit  its  cusps.  As  the  accuracy 
constraints  are  relaxid.  the  resulting  image  should  fu'  the  ex.irt  projet  tion  of  a  3D  volume  that 
.qiproxiinatcs  the  rc.al  one,  degenerating  into  a  sphcre-likc  hlob.  The  Euler-like  relations  can  be 


used  to  enforce  this,  (the  details  need  to  be  worked  out)  so  that,  for  example,  the  two  undetected 
cusps  of  fig.  6  would  be  added.  The  false  Ts  of  fig.  5  are  already  merged  out  by  the  T  refinement 
algorithm. 

Having  the  Ts  and  cusps  consistent  for  each  limb  set  separately,  <=^  the  whole  image  is 
consistent. 

Step  Three 

This  last  step  orders  the  (1 — Ijsurface  regions  that  occlude  each  other  and  project  over  one 
node  of  the  image  graph.  A  partial  order  already  exists  from  the  T  junctions,  but  surrounding 
contours  must  be  resolved.  One  method  of  doing  this  is  to  intersect  the  surrouding  surface  with  a 
limb  ray  from  the  other  one  However  this  is  rarely  necessary.  For  an  object  with  self  penetration, 
or  two  disconnected  objects  that  share  no  T  junctions,  exactly  one  ray  intersection  is  needed. 

A  detailed  algorithm  has  not  yet  been  worked  out.  but  the  following  is  a  sketch  of  a  proof  that 
the  surfaces  can  be  ordered  pairwise,  and  hence  completely. 

Take  a  pair  of  (1 — Ijsurface  regions  A  and  0  that  intersect  in  the  image.  There  are  two  ways 
that  they  can  be  ordered  immediately. 

(i)  if  they  have  a  T  junction  between  the  image  projections  of  their  boundaries. 

(ii)  if  they  share  a  boundary  and  arc  adjacent  on  the  surface. 

If  that  fails,  find  a  connected  path  of  regions  from  A  to  3  througn  ‘he  surface  graph. 

Step  down  the  path,  starting  at  A.  checking  each  region  against  B  by  (i)  and  (ii)  to  get  an 
ordering. 

These  3  steps  outline  the  hidden  surface  scheme. 

Some  previous  versions  of  these  aJgonthms  that  found  limbs.  Ts  and  cusps  without  organizing 
the  surface  regions,  iiavc  been  mipleinented  e  g.,  the  two  views  of  a  helix,  figs.  7,8.  The  program 
of  interpreted  machsp  found  about  100  hmb  points,  and  took  about  4  minutes. 


2.2.2  Image  Accuracy  and  Display  Refinements 

If  Fl  and  F2  arc  jiosition  vectors  of  the  two  bounds  for  a  limb  point  in  the  frame  of  the 
eye,  and  ar<-  distance  li  ajiart,  and  0  is  the  .angle  betwi-cn  their  surf.acc  normals  iVl  and  N2,  then, 
3igu(.Vl  ■  Fl)  is  oppo.sitc  to  3igu(jV2  •  F2), 

TIk'  niaxiniiiin  [)os,sili|e  iiii.agc  error  bounded  by  e,  is  (see  fig.  3) 
ric(l  —  (osfl/'i)  where  k  is  the  ratio: 
uii.ii;(’-|)l.iii<--ili.'t.uir('/iiun  (|Fl!,|F2!), 
and  r  IS  ill  2  sin  d/2. 

This  reduces  to  _ 


<lk  sin  012 
2(1  i-cosd/2) 


.  ,-(l  -  .VI  •  .V2) 

Jy - j - 


<  2c/fc 


This  IS  the  (oiiditioii  for  sfojiping  the  iteration  th.it  refines  the  hounds  of  a  di.^jihiyisl  limb  point. 

For  a  jiroji'cti'd  step  of  length  I  in  th<‘  iiii.ige.  with  siej)  angle  <t,  the  error  in  any  intcr- 
pnlatioii  s<  helm’  Will  lie  0(/'‘inrt)  o  is  .a  iiie.a.siire  of  I  he  inverse  of  radiiis-of-iiirvatiire,  so  the 
error  is  fil/^/radnis-of-enrv.atiire)  There  .are  two  alternatives.  If  the  image  iiilerpolatiiig  er¬ 
ror  ins’ils  to  be  lioninled  by  fixed  error  c.  then  tin'  step  length  I  between  knot  points  sliould  be 
0{ radnis-of-curvature ) ,  However  if  the  image  interpolating  just  nissls  to  look  good,  then  the 
error  sliould  be  proportional  to  step  length.  So  Isina  a  1.  giving  constant  step  angle,  and  step 
Icngf  h  Ci  (radius-of-curv,aturc) , 
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Part  Two 


1.1  Prediction  Singularitiea  for  Changing  Viewpoint 

There  arc  three  idnda  of  two  dimensional  singularities  of  the  prediction  mapping  P,  corresponding 
to  changes  in  the  topology  of  limbs,  cusp  and  Ts. 

takes  the  form  of  a  generating  line  (L)  on  the  surface  of  the  modelled  object  with  a 
direction  vector  (V)  in  the  tangent  plane  at  every  point  of  L.  A  ray  parallel  to  V  is  swept  along 
L,  forming  a  ruled  surface  which  divides  up  the  viewing  space.  When  the  viewpoint  crosses  one  of 
these  surfaces  a  node  of  the  tooth-pick  prediction  structure  suddenly  appears  or  splits  up. 
Summary; 

1.  Limbs  meet: 

Line  of  parabolic  points,  with  asymptotic  direction  at  each  point. 

2.  Fish-tail  appears: 

Line  of  asymptotic  indexions.  with  the  infecting  asymptotic  direction  at  each  point. 

3(i).  Pair  of  Ts  appears: 

Pair  of  T  generatmg  lines,  where  corresponding  points,  one  from  each  line,  have  a  common 
tangent  plane.  The  special  direction  is  a  linking  vector  along  the  line  joining  corresponding 
pomts. 

3(ii).  3  aligned  T  junctions  —  a  star  junction: 

Three  generating  lines  where  corresponding  points  are  colinear.  The  special  direction  is  the 
linking  vector. 

1.  (a)  Limbs  in  the  same  limb  set  fi  e.  surrounding  a  forward  or  backward  facing  region  of  surface), 
touch  and  merge,  joinmg  up  two  regions  that  face  the  same  way. 

(b)  A  new  limb  loop  is  bom  at  a  point. 

Both  of  these  imply  that  the  derivative 

of  (surface-normal  •  hnc-of-sight)  is  0  lu  all  directions  at  that  point.  The  only  way  that  this  can  be 
.satisheil  is  to  have  one  principal  rurvature  rcro.  with  it.s  .xsyinptotic  direction  coincident  with  the 
line  of  sight.  So  the  singuhir  viewing  surface  is  ruled  through  the  surrounding  space,  hy  sweeping 
a  line  t.ing<’nt  to  tli<‘  o-symptotic  ihrtrtion  along  tin'  i  losisi  loop  [laraliolic  curves  on  the  surface. 

Ci  nerically.  one  end  of  .v-xympfotic  direetioii  point.x  into  the  hyperlinlic  ri-gion.  the  other  into 
the  I  llijitir  region.  Looking  along  tlie  .'V'yniptotic  ray  from  elliptic  to  hyperbolic  side,  (b)  is  seen; 
the  reverse  direction  gets  (a). 

2.  Two  cusps  and  a  T  junction  .appear  in  a  hslitmi  sh.ape.  at  a  point  on  a  linih  in  a  hyperbolic 
region. 

The  coudition  for  this  is  that  the  line  of  sight  is  t.angent  to  one  iusyiiiptotir  direction  at  a  point 
where  the  asymptotic  line  li.as  an  iiiHexion. 

To  derive  this  result,  (s4S'  (ig  1),  imagine  th.it  the  viewjioint  is  iimviiig  (with  3  d.o.f)  so  that 
the  two  cusps  appriMU'h  eaili  other  and  merge.  Siin'e  their  liinlis  are  t.ingent  to  the  .u-iyiiiptotic 
direction,  the  i  iisjis  must  .appro.u  h  liy  sliding  in  •dong  that  dins  tion.  which  gives  the  asymptotic 
line  .ui  iiiHi'xion  point  wlu  rc  tlu'y  meet. 

So  the  singular  viewing  siirf.u  e  is  piled  hy  sweeping  a  liii<’  in  the  asymptotic  (hrection  along  the 
rurve  of  asymptotic  infexinns.  This  curve  may  intcrsiTt  it.-ti'lf  or  intersect  the  curve  of  asymptotic 
iiiHexions  of  the  other  asymptotic  direction,  or  be  tangent  to  the  curve  of  parabolic  points,  c.g. 
the  curve  around  the  iiuddlc  of  the  liolc  in  a  torus. 

3(i).  A  pair  of  T  junctions  appear  at  a  point. 
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Two  contours  become  tangent  in  the  image,  and  then  form  a  pair  of  Ts.  In  order  to  see 
this  singularity,  the  two  surface  points,  whose  contours  are  tangent,  must  have  coincident  surface 
tangent  planes,  with  the  line  of  sight  aligned  through  both  points. 

Pairs  of  T  jimction  generating  points  form  into  two  parallel  closed  loops.  Each  point  on  the 
upper  loop  has  a  corresponding  point  on  the  lower  loop  with  a  coincident  tangent  plane,  and 
direction  pointing  to  its  mate.  The  singular  surface  is  ruled  by  sweeping  the  direction  around  the 
loop. 

3(ii)  Three  contoius  cross  at  a  point  in  the  image. 

There  are  severid  interesting  1  d.o.f  viewpoint  singularities  and  some  weird  0  d.o.f.  ones,  where 
the  viewpoint  has  to  be  at  one  special  point  in  space.  See  |lj  (pages  145  -  149)  for  a  complete 
classification. 

An  important  local  1  d.o.f.  case  is  the  borderline  between  1(a)  and  1(b)  where  the  asymptotic 
direction  is  parallel  to  the  parabolic  curve. 

1.2  Viewing  Cell  Graph 

A  representation  of  the  mapping  P  needs  to  be  built  up,  based  on  its  singularities.  Just  as  the  tooth* 
pick  structure  of  G  supports  symbolic  graphics  and  predictions  over  a  limited  range  of  viewpoints, 
this  representation  could  provide  a  framework  for  general  predictions  and  anim..uon. 

In  I5l.  Koenderink  and  van  Doom  describe  a  graph  structure  called  the  "Visual  Potential” 
which  predicts  what  an  object  looks  like  from  its  different  characteristic  views.  Each  node  represents 
a  volume  m  the  viewing  space,  with  a  link  between  adjacent  volumes.  These  volumes  are  sliced 
out  of  space  by  the  ruled  surfaces  described  above. 

To  be  useful  for  recognition  or  animation,  it  is  not  necessary  to  generate  the  whole  graph; 
It  IS  enough  that  at  any  viewpoint  the  structure  of  the  graph  locally  can  be  generated.  This  is 
analogous  to  not  generating  the  whole  image,  but  only  being  able  to  work  out  what  the  image 
looks  like  near  a  single  ray.  At  a  node,  something  like  the  “tooth-pick"  structure  could  be  stored; 
.■vlong  with  the  likely  singularities  (3  different  types),  so  that  links  can  be  generated  in  response  to 
a  change  in  viewpoint.  E  g.,  soe  fig.  0  for  the  sequence  of  views  of  a  “dumb-bell”,  moving  from  an 
oblique  to  an  end-on  view. 

2.1  Deformation  Singularitica 
Some  of  the  local  siiigul.irities  are: 

l(.i|  A  parabolic  curve  apears  at  a  point  e  g.  stretching  and  bending  a  sphere. 

(I>|  A  parabolic  line  pinches  off  to  form  two  pivabolic  lines,  eg.  tuniiiig  .a  banana  into  a  dumb-bell. 
Tins  r.ui  only  happen  when  the  two  points  that  approach  each  other  where  the  split  occurs 
both  liave  asymptotic  dirertiou  tangent  to  the  parabolic  hue.  The  two  points  aiiiliilatc  each 
otln  r  at  the  split.  (They  are  a  jiarabohc  hue  .uialog  of  cusps  on  Unihs.) 

2.  Lines  Ilf  asymptotic  inllexioii  appear  .ntd  split  Their  cusp  aii.al'igs  are  jiomts  of  self  intersertion 
of  iiilersistioii  with  oI.Ikt  curves  of  .Lsyinptoiir  mtlexion,  .uid  where  they  .-irc  tuigcnt  to  a 
parabolic  line. 

3  Similarly  the  T  generators  appear,  merge  and  split. 
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2.2  Deformation  Stnicturea 

The  singxilaritiee  produced  by  changing  the  surface  shape  suggest  a  model  hierachy.  One  object 
might  be  described  in  terms  of  another  by  giving  the  sequence  of  singularities  that  occur  when  its 
surface  is  deformed  to  fit  the  other’s.  E.g.,  Forming  a  “dumb-bcU”  (see  fig.  10)  by  deforming  a 
sphere.  First  the  sphere  is  bent  into  a  banana  shape  when  a  paraboUc  curve,  bisected  by  a  curve 
of  asymptotic  inflexions  appears  at  a  point  on  the  sphere’s  surface.  Then  the  two  ends  of  the 
asymptotic  inflexion  curve,  which  are  also  on  the  parabohe  curve,  meet  up  around  the  girth  of  the 
banana.  The  parabolic  curve  splits  into  two,  and  the  banana  becomes  a  dumb-bell. 
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Appendix  E 


GEOMEra»°D»|lTfm  MODELING 
OBJECT  INSTANCE  AND  CLASS 


Imm  TiiiMi  »•*  Amm  O.  BIbM 

Suafaf4  UftfwrMcy,  3iMiai<  C*iJianM  MM 


fW  pNpfv  M  Ito/lfc#— i.  wr-^iUJv  fcmmttru  mm^ 

ekttf  wkmit  maW**  wwpfi,  fmM  AiMay  a/  SO  mmdtU  /•»  Ua 

/fVMf*  «pate«L  fvit,  m  twMnaa  a/  «i  4**yccl  ta  tM#^ 

tfcwfih  l4a  ipaf^aai  «  gmiraiiw^  T'lfMan  ara  /lOai  la  —tk 

part  if  m  tmm^  V  <Aa  aly  art  «  ID  /mmad  kf  rtaata  anapca. 

MaM  iaaff^i<aa«a  V  ^  rtrtaaaa  aai  praafsiarf  aMaaMMiaaUp 
•ptpmkmm^  Smmd^  dam  mmdtt  af  tkt  ttfwHmkmmadmd^tlim^  aaif 

alia  ftwaviriad  Aa  praartM  aMdal  iaaavapiirtrt  mm  At  aaarf  aa  aipat 

t/iM  iCiojmrtirtiA 


i.  iMrMMtlHi 

Aa  iW  WMTh  ^  ■iilrilrtfA  irt^T  aailrrrtMtlta«  wfmam  aA- 
WMW  imA  khfw  afmtmm  mmt  m  ba  ap|AM  ta  tba  frrrapiitina  d  mg^ 
tmm  aa  aitrSiaai  aanMiiHl  ayaawa  alikli  ram  UaiU  10  lanibiit 

HIlrmMlp  a  hinaartiap  m  rnnay.  Naairly,  a  laoiHuMi  •frtrm  wUrtb 
reiiU*b«  mtnda,  Caal  attMlrl  bntklMia  a  fref«iirr«l.  Alan,  (lu*  imat 

(ir  raar  Irara  m  imaa  bna  in  \mdii  II)  tiMwIi-b.  a«i<l  naaf^friraallf 
fmvi  tbe  iiaaT>auit  d  tba  aaer-uitrHfira.  A  ffwirm  for  ffoauictne  mod> 
rUaa  waAad  Siarau  MiHlHom  Srttaa  vUkIi  aaiaAm  tlioM  rt^uircartot 
UAt  braa  Arttpartl  anU  hailt. 

la  tba  ACSOMYM  afwmm*  30  sniWb  wra  bailt  tlirovfh  ihr  trsa- 
Haaad  dtacnprina  TLr  proba^  wat  chat  looAal  tirarnyciona 

iBciat  ba  Bade  bj  awianriaa  earmna  jiaraiaHrfP.  ^nrh  aa  tbr  mac  d  a 
part  d  Urt  obiort  aaA  Um  aask  brtwwa  par%».  i«i»«l  Hy  vntuif  uuc  kioc 
rQ(nlrl  dMrriptioaa.  for  'Vaaplr,  tn  bnibl  a  a*4Mb'l  d  a  rclatiTehr  ampla 
obpri  lika  aa  aircrr^ft,  a  cofipla  d  huadrrAi  Ui<^  d  iikhIcI  daxnptKiaa 
w«t(*  mtmrcU.  It  a  i»ol  raay  Ua  a  ptTaua  «lw>  <lcwai  nnt  bara  caoiicb 
ktiuwktipc  d cnapuU'ft  ui  KmmIIt  (he  laoAniittfi  iawpiaar.  Mucmvir.  aa 
>lir  oioArl  doarnptioitf  are  iiiaAe  hp  w*r«  lu  intMiel  draerTptKma 

.vt*  hkclf  to  ocm.  la  or<ler  that  n  m«alrbai|  ayateia  may  he  wnl  videlf 
ao<i  hr  appU*«l  to  tmrionm  objecia.  it  m  I'laal  that  t  ven  a  iMTtmi  who 
ta  ooc  a  cumpiitrt  rB|>rrt  rau  bmlU  30  ui<airb  of  obprta  eiwly  -vtA 
wiihunt  crroia. 

TUr  30  oioitrl  liaa  alan  Uit-n  «rnvlioil  in  Uic  hrlUt  of  ('AO  tad 
riMiipttirr  ((r.-Hiittca.  xUc  nmjnr  iii(ft*rrtirr  iM'CVfrn  30  nio«lrb 

Ui  hi-Uia  CT*iMriaUy  oi  (’AU  •Ui«l  >u  luiac«*  UiMk-rwCaiidinc  m  (hat 
lu  the  Uttrr,  objcrta  to  be  iu«MU-lrtl  'iriiiaUp  rxiat  lu  (U^  vorbi-  With 
ilm  .wlvaittaor,  thr  rjratrw  bnihU  iBo«lr|p  d  uwiUMire  oitl  cltoa 

fniiii  tctiial  etampka  d  lha  ohifvt  tkrunsli  Uic  roiltevinr  rvo  •arrt'WMea 
•taoea. 

1)  A  ruiMlcI  nf  aa  ol»)erC  ioaiaate  •  tirtipirt  uiirrartivciy  ot  30  f>pma 

funned  by  hu-it**  Moaoro  d  im  mumipkr  and  a  ■  c  .  fa- 

(■urtnc  featurra  d  the  ohirrt  .irr  i|»nBAhr<i  dirrrtiy  m  30  via 

(He  iw«*r*fnmd(7  inurfarr,  f«tr  eiac«varr  *<•*«-  oi't  rurae.  «i(hottc 
rprabuhe  drarnpciona.  (icduuiif  pmv  knnvinire  <d  ihc  ••h^ret 

2)  Tlir  pytcein  Irariia  thr  uimb  1  d  tlir  <<l>pTt  rl.wa  irriy  t  >irf>*iKii 

(hr  luodi  U  d iaalaacrt.  uii«l  UuiUU  tn<ali’l  <Uwri|>iitaui  d  dir  >4i|eci 
rhwp  /uiUMiuuir.'dly. 

Tl»r  ia«alH  liMtldiiip  d  tthfrrt  uiai^yirr  a  iIium-  try  hitmt  4’rarr> 
ahartl  (’yUadrrt  to  mrJi  part  d  (In*  rviuiiptr  in  JD  'a« 

rutt«|Hyifliai  at  (tiir  <1  »l>Uirr,l  (  b'la  ■ritlMi,l  Cfl.  iib  r  uiil  ilo-  •  I'l.U  iiIk 


jart.  Tia  Irackn  Hiridai  tlH>  ofejacl  klo  aTrral  pai*  ccrenliac  ^ 
irqnurd  amtney  of  iiiiiinnaihia  i^fTiIrK  icUtiaaa  b4.rt—  para, 
Mul  baiUa  ikf  aadil  the  whnia  patia  Hirmltir,  aakiaa  ^  the 
ikwriiiUiaM  thr  |aw«e  •liirh  Me  eiRMlr  <lclfaW.  Tbr  erMoa  cak» 
teiie  pentMcim  Mirk  m  the  mw  ef  thr  part  nr  the  eaaie  Wreeie  puee 
Mut  anmora  laailrl  therfipiinaa  ef  tha  ehfrrt  inMeare.  Sertlea  1 
wnhoi  the  ilePuli  tt  laae  a>  haiU  ■etaare-  aadehL  Clam  aodeli  Me 
hmlt  by  ir»r<ell«Nl  aoM  •leeaipMaae  vliMh  Me  repmeed  ia  lecw 
■ivbfeir  rewliMaM  Clae  Madeb  Me  Um  ■vroaUaed  hy  «-l«tt«y  aew 
nmetmaht  nliteiard  thieesh  euMaregetUea  npMhwaa  Tbt  detaib 
ei<B  br  daemhed  ia  dactaei  X  itfMdyuM  p  l■llll^i  ImImm  (d  uh|ac« 
ilifrrUy  ia  ID  •paea  mmI  Irarhi^  hHlaaee  MadU  ea^  mi  oaBpie  ef 

thr  nhjret  m  lha  aaM  mtaitim  «er  ta  bedd  3D  aadife  . . . 

leahiaa  rmwe  ei  eaUei  daMriyeiaae  am  ha  pmniiad  by  the  ptecedere 
m  vhkh  a  hnilrihai  30  Mnad  ■  ilbphipwl  ead  Ungra  eeatpared  la  the 
ariuai  raaaMd*.  hi  jiartaM  4.  thr  amt  mtntan  a  deanbrni  a  detail 
thtiaiaa  thr  ariaal  OBUMle.  Tia  yrartaird  laniM  ibMiipliiew  ran  ha 
MB  lUfart  ehyiat  Mndrh  tt  tha  AOftONYM  eyaam. 

3.  rutlac  OaaaralUad  Cyllatlaae  la  30  SpMa 

3D  uioOrh  Me  aanaliy  hnih  by  nmnf  aaadard  ctaspeaiaM  like 
cyluidoa,  pariUlrIrpipei,  r|>hi9ra.  etc..  30  mndrhi  can  Se  coiuitjeial 
to  iwf  deftae  of  wcamjr  >r  thr  utuabe*  of  the  taria  a  ■•icraaaad.'  Uoa- 
rva.  tractai>iUty  end  inuplicity  rather  thaa  uerruM-y  id  the  model  a 
iiiipnrtnat  u  iiuiMa  aaiirr'taaiiuig  for  the  peoceawp  etacee  <d  pceihc- 
ti<Hi  Olid  inatfliiin.  Cirni  rohird  CylindcTa'  have  hcca  widely  uacd  m 
iiiih  lararTfiil  cuiapmctii,  foe  thr  30  okmItIb  ti  uawar  gaih-ntaudjof 
lyBicnu.  for  lartiuaa  the  ACRONYM.  The  Gaacralued  Cyliailn  ■  oito 
u*ni  M  a  ptuuura  ler  buihliac  Meilrti  a  tha  eyaeak 

3.1.  naaaralUad  Cylladaa  fitttac  Utbi(  Kaata 

Tlir  iiiera  iBliiiliTr  wi^  la  badd  30  aodeli  a  to  build  aodrlr  di- 
rrrilf  in  30  space  ricwiad  actaal  30  rieaplra.  30  iaiiui  actbn^  here 
.-Uju  iHsrn  iiudii'd  m  CAO  lad  CimipitlrT  firaphica.*  Howerrr.  m  the 
rtw  id  30  mud.  la  n<  iiaace  uiidrtalaadiiul.  .vtu.ii  ohircit  oauaily  rxui. 
Ill  iKia  system.  3D  uiodrla  .ire  Innit  rtliriciiity  ui  30  space  forimsl  by 
•trnsi  iiiiNcr*.  ImwmiJ  im  actaal  cmiuiplca.  N.uiirly,  .i  strnsi  thapUy  id  ta 
I'X.uiiiilc  ai  rtewni  tlixiinah  a  ili'rrMri  upr  and  i  In'  Cnirr.ibtcd  Cyluidira 
all  hill'll  tv  I  aril  iiart  ul  tlir  iil.jis  I  liy  s|>mryiui|  kiiou  in  30  ipaca 
l  lir  lariuiriirp  id  rmra  ui  ilic  iiinilcl  ilratription  ran  lie  prcYi-ntnl  by 
*Uv  imitinunua  nimpanaiai  id  iliaplayrd  Geuerahacd  Cylmder  wiili  tha 
actual  nhiicl. 

Ac  the  imaietnc  aodehiia  id  syntbrtic  iibimirca  rr^una  a  hifh 
ib'Mre  ed  ercaritcy,  luaay  kaoia  nuiat  br  a|MTiAcd  ia  tirder  lu  6l  laodck 
tji  rnrata  oc  snrfiwra.  Allhuiiali  tlir  surface  ciui  br  (llnl  with  aay  accu> 
nu-y  hy  pulylHsIrnl  .i|iprunaiiaina.  input  and  inniliHriitMai  ud  thr  uindcl 
w  iMit  riMy.  Tlie  bltini  od  rnrsrrs  lOid  siirfnrrr  hy  Odairr  nr  O-spliaa 
rnriuiihitaiwa  U«i  minirta  imwiy  rinilrol  piNnle.  Hutararr,  ilrarrihioy 
iiiijrria  in  terms  id  Gcia~rahsril  (‘yUiiilrra  fiw  lUr  piirpiwr  id  iniaee  ua- 
<b*nit.unliiiic  pnrinaa'  riui  be  ihiuc  simply  liy  thr  fidhTWimi  Dictboil. 

I)  Fmin  kiuila  bi  a  rrwa  m'tiua 

A  (Irin'fidiartl  Cybntb'r  w  ih-OorsI  liy  a  rmra  srs  uoa  widt  li  swi i  m 
.(hme  11  s,illir.  chalicuic  sJia|ir  arrnnlinc  In  a  sarrrpini  nilr  w  it 
iimtiiiia*  Pi  mi  rp.  Tin*  ty|n-«  .d  (•rneriihaitl  (lyliuilrra  aaril  m  tha 
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Tula  1.  Trpm  CwraMaad  Cyliate 


■  rifan  i.  All  tha 
ba  tIMil  kr  ifciaa 


Crttalw 

CylM*  ■  (omA  br  a  cfaa  «ac«laa% 
lha  irpn  <rf  (IftabaaJ  CyUaAa  la 
bf  tbna  ciaM  aactaaaa  ai  aMa*. 
aaa  naakari  to  iba  af  (!«» 
a  ctoato  apiaa  aa  ibiaia  ia  F>«aa  1 
to  tba  nr^  M  <laaanttaaA  Cvlto 


ta  At  I 

caaaaa  ir^a  al  OaaaaiiaaA  Critoirr.  wbacb  baa  a  attalaM  ipiaa 
aa4  a raaataat  avfafiail  tala,  aai  ba  naariAaA  HAcinitlr  aaiai  oalr 
fnar  knata  aa  AtotiMaA  ai  flaan  A  Oaa  ta  tba  waalba  naaib* 

rt  waaa^tl  kaata  raaipMaA  la  Iba  ramai  aarfarr  NlUna  aaA  Iba  l» 
rui  rimmOalaiitT  ai  tba  ilatyi  <if  rma  •artaai  llliac,  <!aa 
C'rtiiMW  Hlliaa  'aa  ba  Aaaa  aaialy  aad  rttrimtif. 


Flgwa  ti  Aa  aiaaala  lillua  a  croat  •dcHm  bf  tbraa  kauta. 

1.3.  Utiaa  Pti  AtIhiaA  Paata  Eflahatljr  la  Ma4al  BallAlac 
S<Maa  30  ubfacla  toaa  a  bnaacbical  MnKiitn  aad  han  ili«  laiaa 
•ulifiafta.  Oiira  a  part  a  •IracnbcA  at  uraia  iJ  a  (M  ncrabaLil  <>Uaviar, 
lUe  JtiatipUna  raa  ba  aaarf  a<  ilrllaa  mbcr  (wru  rtAcimUr  rVaiUaB, 
tba  bM  Iba  «laaaU^  that  30  UMakb  raa  In'  ilrarribril  la  rianpacl 
fonm  «a4  aMdiAcatiaaa  raa  br  iloar  la  all  lla  comuaa  pana  aaiiil» 
nroaaif. 

1)  Mratical  pmt% 

Tlir  aaiar  .b^ailina  nf  Ibr  ( b'lirmliKaJ  (’jfliiiilrr  cm  br  .  iiMinialrA 
by  ibr  i«*lrrlaai  ctf  .yi  aJrv’Mif  itrliiicil  tiarl  luu/tr  <I  tba 

n  lauar  pcwlaai  aail  tbr  naaaibOaai  ul  ilir  |Mrl  a  nlmlwai  to  ab 
rrailp  vlrliani  iMrla,  apn-iArataav  irf  Hir  n  bunw  JnwriU-"!  L\ic» 
a«T  lait  la  rcaaary  rttbr*.  Oila  raaa,  ilirrr  Inula  irr  nrrraaarr 


PlfanAi  WtHiAbC— aBwBOlhtofc^kaato 


fat  tba  ipwtoatiBaa  of  tba  paailM  aa4  tba  latatiaa  ri  ita  local 
riinriliaaiia  iritrat.  Itoatoa  ibAaitaa  ol  tbr  akaikal  pant  » 
nblra  tba  aauitaaiaMai  ibtoiliaa  tj  aeaaaal  idabMal  partb  Alto 
tba  Ccamlucil  Cllinite  iliAaHina  uf  iba  Aral  aJrntkal  part  aad 
■pcciAc^iaa  M  tba  aaabar  of  itaiabaa  paita.  taa  ur  tbna  taaala 
arc  n>anAeil  to  tlrlrnaow  tba  laaaliaaa  ti  Iba  iwt  ri  tba  alraacai 
par*.  Naaaly.  il  tba  piaihaaa  tba  airabcal  pac«  aca  amlar, 
tbcar  kaeai  .yc  minired.  IT  tba  pwljaa  a  Uaear,  twa  kaata  era 
rnonah  to  lialcrDiiiaa  tba  puatliaaB. 

2!  Synunetncal  pact 

Sotua  objacu  bavr  rymiacincaJ  mlipartc.  TV  rroimetrical  part 
rail  .ibo  ba  ilrvr'lKil  la  terma  i4'  tbc  ouxlrl  ilramptnaia  almuly 
Jc&aetl.  For  cxaiiiplr.  the  port  wiPt  nl  liir  oiijcrt  p-t  lirrraA  a 
•yoiniclnral  ui  •t-wlawnl  aiiia.  In  iliia  rear,  ihr  •pmlltatinia 
ol  port  aim  ran  t*r  i  ltiniiMUtil  by  ntiJuuia  ilic  ilctiiiliiia  erf  tlia 
"I  vhoaril  aina  wlurli  m  ^ytufaruicai  aaaiiwt  tU#  y.c  plajir  »rf  the 
roM-laar.  TV  moilrl  •li'arriptioo  trf  thi*  puct  aiaa  a  rrni'ratrrf  fruca 
tbr  licrrriptuaip  tUi*  ^talMwrii  wtnp. 


Flftira  4i  Fittiat  a  ( Ivart.ibccU  CyUa*lr«  by  fonr  kaoia. 


U.  E«Utl«M  batvw 

TW  tMl  nonMUic  fttatte  I 
Mihii  ■  ww  of  (It*  whtiti  | 

U»«  jpc^  ronrHiiiia  lyw  *f  tW  ft  f  i 


raa  ha  ^»aiir4  ha  Um  acmte  <lr<ai>tM  af  thr  | 

»a  irhiHf  tti»  Aligh.  Cayla— .aaJFlMhfhai 

«a  othn  pm%f  ahirh  at*  ataraily  lirtead.  U  ihor  kiaib  of  idaUsB  «ia 
ipcciM,  tW  beat  toantaalni  itf  the  GeamUiard  CyHada  b  bieWf 
leBililiJ  tad  iheamnMa  aoM  iharriplbae  ere  ji—aiaJ 

r  mhftt*  Heiiia  hibn  ha  «pari>i4.  U.  the  wmm  el  the 
N  ha  deiaad  ahaa  the  eahpeet  ie  epacilad.  The  veM 
I  •  abpait  oaa  a^  the  Muaa.  If  the  ohiacl  nnapb  b  aal 
apb  of  the  daae.  the  Maw  caa  I 


S.  faeaaha«  Objaat  CImb  I 


After  the  mtdtl  dtaeripuaaa  the  ahjart  I 
m  iteirnh  ei  la  laelbB  I.  tha  madtt  W  the  ohiaet  ctaaa  a  I 

hwb  ea  tha  raeaipha  at  wabab  aT  the  ah^  taabweea. 

S.1.  Kapfaaeatailea  tor  * — ~***H 

1.  At^nwnnt  ^ - - - fri  iih|  it 

.»_■.■■  1.  — t.  A - ..j — - *  — ii  Uaiw 

heaa  a  art  area . .  baW  arhaaa  tOaie  drdmt  thrif  eahaa.>  OtbarW 

era  irpeapeaaab  hf  objert  «raph  ahoaa  atta  ara  laihpan  wmI  Biwial 
Thr  aahaaet  aw  ibaewba  a  maw  la  taa  larartafal  hinaic^  iape» 
hr  a  aihfian  tfae.  Allaairai  am  irlair  cnaniiaaM  tfaltmt  ti 
aliiaeu.  ilmm  a  irpmeaBil  thraabh  a  iiinrliaaaaa  rt  mmtnmrn  md  a 
raatnelwB  vaph.  The  rnaetTMit  a  eubhelitba  oa  altrhaic  rrpiiaahiaa 
*hwh  Maae  a  aal  ef  ^aaa  which  caa  he  tahaa  hr  altahiait  spaaa 
MM  a  tha  abc.  ia^  S-O  ^  aatoh  i  h.O.  The  laainctaa  c>aah  b  aaa4 
to  arfaawa  tha  ceaeantoia  ana  ctaaa,  aabclaai  aa4  iaalaara.  Naaaelr. 
a  art  if  rnaairaiaia  raa  ibtow  ohiect  ctaaa,  aahrlaai  or  aataaaa  aa4 
the  hienwrhr  if  wrh  an  af  caaatrawaa  caa  ha  driaad  hr  nachetna 
iaa|<h.  Fifarr  i  toowa  m  oawpb  if  tha  ctaaa  hisafrhr  if  tha  >al  ^ 
dan.  Tha  amba  ■  each  trrai  haaa  i  laiiap  iwiliaa  coaecraiala.  thoaah 
OBk  aat  id  nhpan  me.  atomal  trap,  eytaiitar  toaenpuaM  oiIb  lor 
the  ohieei  clan.  Thr  naaalrMaai  tha  wrii'rima  wa  aaphad  la  ba 
aarrnwiw  aadaa.  (or  iaaiaaca,  the  rnaarrMaia  af  Ih747  aaa  applM  la 
hoU  1V74TTI  aa4  D-74TaP. 


S.3.  Rulaa  af  CaBaralUallaa 

GearraiiiaHea  tn  (urw  a  rlaaa  model  caa  be  dona  aMpIr  aaiag 
to  the  It  priat  iitaaai  dcambrd  chmre.  The  niodcl  ikacnpiwaw  of  tha 
obpri  uutaarr  bull  hr  the  ar*tr<a  aa  deoenhed  to  .Srctioa  1  are  anitcB 
m  icruia  if  lonatraiaUil  a  one  ff  the  forwa  ef  the  ctfMCraiaai). 
TV  cimMrauiU  ran  be  nartl  {>»  ranMiuaw  la  aue.  la  Mroeloie.  aad 
m  ipaiiai  fobuioaabpa.  Fia  oAiupte.  a  airaetorr  can  be  aepnaaod  hha 
LXII-UUANTITY •  3  Cmnahaataw  of  the  wodrl  deampiMaw  caa  ba 
dnac  hr  mrratiaia^  thwa  wiraial  Far  esaatpb.  aappMa  D-747D 
baa  iha  eoaaaraau. 


fvszlagB’Lxkgthw  it  J 

aad  1V747SP  haa  tha  caaairMat. 

FVSZLACE-LENGTBo  M.t 

Tbrae  roanroMia  are  iraeraliard  uhI  the  MIewinf  raiwtraiat  tha 
FI ISELAG&L£7((ITB  tf  the  rleaa  13*747  a  ohiauaed. 

33.0  -  I  $rT)!ilLAGE-LENCTBS  07  3  -a  < 


Cl4si;  Gantric  Jet  Aircraft 


•  SubptPt  tr««  a  Conttraint* 

Afflabaat  trap 
CyltaObr  datcriptlont 


a  iswra  ai  aa  oaapia  ■  (M  rlaaa 

Coaatfaaia  hr  atawetaa  caa  ha  | - 

V  tha  ean^Mdlap  aahpaaa  eaaaaa  ha  fanad 
,  tha  paaiihtr  af  the  aahpaw  ■  that  i 

lapaadad  aaP. 

la  wiwaaaiy,  tha 

••Pl*  ■•d  todthaa  lha  maaa  af  the  etaa/aabete  la  wbch  iTbah^ 
The  arwaa  pwenhaaa  tha  awdel  toaciipciiM  tha  ohiaet  elMa  a 
■Idaibad.  Wiwaly.  ail  the  caaaUaiBW  M  the  pradaacaaot  aniha  a  lha 
mtiictioa  vnph  wo  paataliaff  For  esaapla,  if  aa  add  a  aaw  ^ 
acaacr  to  tU  daaa  lh747.  mf  0-74TX.  lha  iwinwa  a  aada  'B-74r 
aad  ‘leaoric  aimaft'  are  leaaraUaad* 

Tha  iadartm  baaaiat  daaeaihad  ahaaa  ana  oalr  paiMaa  mp 
pba  aad  lha  aiadai  dc*enptaeaB  inwriMii  haeaaaa  n  iniwulliad 

Tha  pparbibatiea  af  the  ctaaa  wadal  thraaph  lha  aapaltoa - 

or  coaaictmaniptce  ahniilU  ba  deaa.  la  thb  araMaa.  daaenpta^B  tha 
clan  model  caa  ba  irtmatiaed  with  tha  additiaa  af  MW  cOMtraaw. 
WhcB  tha  ACRONYM  >rWMi  Mbrec^iaM  m  ohiaet  wUch  a  aot 


tPrruMpta.  Uatap  ihia 

arw  type  «f  raanrani  ■  lha  wadal  dneitpataa. 

Irma  erawpba  caa  ha  ra«neaiaed  iala  two  trpaa,  Ito  am 
Uial.  aad  the  otlwt.  mirawiai  •Althoaph  thb  a  n  wialil  waahsd 
paraileb  howaa  baniap,  a  a  apt  to  had  awe  dwww  pwdto  paato  hr 
aa  aqadkinBB  rhoke  id  iaitial  Mawpba  at  hwMntatiiai  tha  hwab  af 
^  eeacepr.'  Tharrfwe.  ia  lha  rrwoa.  lha  laaetor  amt  aabai 
saaipba  for  braiaip  pmd  clan  ihomtiaaB.  Fiaattr.  tha  i 
cuRratir  bfiap  plaaard  to  brlade  map  type  of  c 


4.  Uaar  lalartoco  aad  ^ — iirpln 

Tha  nan  fraadlr  ialPtfaer  cf  baifalwp  aaodeb  ara  draniWd  aalM 
nr'nai  raawpha  w  thb  awiina.  Nanadr.  tliP  larChad  la  wpnl  kaaaa  w 
30  WMcc  lynl  to  It  Utc  Gearratiard  CrliwirT  w  ihwenhcd,  IimpiI  oe  the 
Gcaoratuod  Crliadrr  liiiap  awthed  ihwcnhid  w  Saelhw  3. 

4.1.  VaoMftbadlp  lalortoaa 

riptaa  •  toono  the  Mlawiap  harilwwa  dtebaa  which  wa  nod  m 

mm  iaiarfwa.  (t)  Seaaont  Stmwaenpa  OD6S  ID  (3)  dbplop  deetco 
tw  warew  aaapea  (3)  Vowa  Roenpataw  SYIOOQ  (4)  iiwekha  (S)  TSS 
Irrwiaal.  Tha  oraww  pparraara  30  wadrb  Ihlwaph  the  faRawt^  wm> 
Irirwdir  wmlacB  WM«  ihnw  bardawo  daeaaa. 


The  qrwpaa  a  deatpaed  w  oap  iwtr  twin  aad  thr  pniailap  deeiea. 
TW  her  haaada  ara  aal  onotlr  and  Mcipa  ia  the  caM  whww  Bonn 
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"•  m€>im  fnlgiiag 
•  niUai  s  ciRaiav  < 

» illgfclt  I 


4J.  SUbm 

Sutea  «f  obistt  «•  obuiaed  br  pl«j^  abi«(«  ■  haai 
ti  a  aMM  riMwa,  CoicMlf,  lha  wiHt  atawa  eaaaa  «  ma  aad  aad 
Mcaan  aaaara  arUck  an amad  ■  a diak  lla  wa  aacd  bf  Cha  ijil^  Am 
dambad  bHbn,  tba  aar  piari  tUhnata  ii  aaiactiMa  aarjr  aapoftMl  te 
accaran  (’ram land  Cpliulrr  Mttiag  ia  JO  nan,  aa  a  lii|li  rraalalaa 
liapUp  daafca  b  aardad.  To  aaha  thia  ptobim,  aa  bail*  aoom  ri — 
La.,  a  pant  la  ba  ■odatad  na  ba  aaWped  aad  Uaplapad  abiaaia 
accanaa  ■ndaiiap  ia  lapaind.  Tltia  annai  (aactiaB  — bba  accaraaa 
taniblap,  aa  if  a  hipb  naailalina  lUaplap  deaira  aaao  aaalahla.  Alaa  b 
b  bnaat  that  iba  abiaa  amn  Uiraarlaa  dnaM  ba  hif^maialiaa 
Far  tbb  pupna,  ia  addiliaa  la  Iba  aaaaiai  bar  pirtan,  htcb-feaato«iaa 
•trim  aaaan  aaa  aba  nrd  bp  ibr  apaana.  Aap  portioa  id  Iba  alaaaa 
uuaara  ailb  aap  laaobiba  an  Ibplarad  aarag  iba  laanbaiba  |i|imii 
ct  Iba  aacna  lataan  oiib  Uib  loan  eaanMad. 


FIgmra  di 


Tba 

CpUadar  Itliag  opi 
jact  aad  a  haad  a 


apaa  b  anarbBp  aaM  I 

oa  tba  oackbaA  aa  daaoibad  1 


caa  ba  takablad  bp 
kai^ 

.  JO  I 


Vanaa  naan  baard  oa  iba  Ibaaay 


4.3.  SO  lap«4 

Tin  baan  aipaa  b  daaa  dfaattlp  it  JO 
a«aa.  Tba  poaMiaa  af  iba  baoa  ia  JO  apai 
currapmiliaa  pania  ia  t«a  iliVi 
rimoananactty.'  Fran  tba  rbapani  id 
pal  a  dan  iknapb  iba  faUnaiaa  raa 
1)  Coatn  iaiiial  pnbiinaiag  with  lara  caiana 

Tba  foaan  nlial  poaibaa  id  tba  baoa  b  nniiad  bp  paiaaiag 
comapaaibag  paaan  la  tba  aiana  uaaan,  aaa«  na  cniaan  d 
pUped  oa  tbr  aaoM  cpip°*ar  liar'  ia  Iba  barn  pa>.  Allbaagh  1 
30  ixnlioatac  oaiaf  (he  annai  lainad  bp  iba  Uacbbal  b  (aai, 
n  iinpimhb  to  afu'arfp  iba  poblaua  braama  oaa  pind.  Tba  a 
pizd  ilbianip  baiwrrn  tba  cnrmpooibag  pouM  ia  bran  nai 
tamrtaaa  adcata  (be  arrnracp  id  (ba  ibptb 
coaalp.  Tbrarfaar.  at  anlra  to  praaliub  iba  baal  ■  JO 
a  bigb  ibabn  af  aarnrarp,  Iba  ioiloatatl  JO  poblra,  ohirh  aaa 
nwrard  ai  JO  nna  anih  aap  drpn  aacaraay,  b  aard  tm  I 
pinita^  af  tba  baaa. 

1)  Fin  pinltaaiai  wHb  JO  patoln 
TVr  arrania  JO  paailin  af  lha 

JO  IT — Jbpbbbd  ■  JO  npaar.  Tba  JO  piaaira  ana  ba 
ia  ba  dbniian  ia  JO  nan  artb  na*  ran 
ai  Figan  T.  Aba,  iha  nard  af  Iba  JO  piaalna  aaa  ba 
i.a.,  lha  nnd  rn  ba  rbaagod  la  a3  aad  I/I  bp  *fbal*  aad 
naaaaada  mpertmip.  Fat  inliara.  d paa  lag  %hn*  thna  in 
Uic  aprad  b  irdnod  la  |l/3)'  >  l/l  TV  JO  piaalar  aaa 
ninrcd  la  JO  n***  nAat  nil  tbr  aaitial  lapai  id  arrmarp  kaaaa 
grarratiag  a  onan  arriina  ■«  a  ('(arraliirH  CpUadn  b  lai 
AilVbgh  b  b  lUandl  la  ilbpln  lha  JO  pnbbaa  hi  tana  f 
iu  Iba  aorar.  >ha  JO  poMlm  id  tbr  baal  i-ar  V  drirmiard 


ilb 


4.4.  fraanplaa 

Tba  aannabafbn  dawiibad  ahna  ad  ba  abaaa  ailh  actaai  » 
anpba  d  Cnmibii  Cpitadra  Filliag  npiaanm.  Figan  I  daaa  a 
Tapiaial  oaigiaai  ntana  pab  af  bihiatnai  patia  aitb  a  ca—aad  raaafc 
Suppnr  oa  bodl  a  landd  ad  oaa  of  iba  pana.  AAa  tha  tom  ca» 
niad  b  arbrtcd  tad  iba  bialin  d  iba  tom  ^l■l1aa  b  nndad  abh 
tha  tnckhol,  iba  calafgad  bana  |wa  d  tha  aba  lad  pm  b  ilbpligad 
n  dwiaa  ■  Figan  li  WHb  laa  oaaabtind  eanaao,  tha  iniiid  JO 
piniin  d  a  kna  b  ipardad  n  ibiai  m  Figan  10  lAra  tha  ippa  d 
(iraraabard  (’pliadn  b  la  bread  hna  lha  am  a.  la  ibb  Rgon^  ■a* 
•hnoB  thr  pnilBn  d  dm  dp  iprrdrd  kaata  AAn  tV  iperdcadan 
d  thm  kaoia.  Ihr  kanta  nun  V  aoand  bp  abaliag  laie  kvu4  «bh  lha 
rnnaa  pnialiBg  la  lha  abiaitp  d  tha  kaat.  TV  JO  ponira  *f*  appaan 
aa  dmm  ia  Figan  It  aad  iV  JO  pdam  caa  bo  aiinad  be  JO  nan 
with  aaba  canbaada.  Tha  iHnplaprd  naai  ariin  nhaan  ia  Figan  II 
b  tba  oamd/ltaadamad,  irOrrtbp  lha  am'imae  id  lha  JO  pdaaaa. 
Afba  Iba  IttiBg  apcmtiap  d  lha  nan  nctm  a  baabad,  thr  baa  baa*, 
ia  thb  raaapb.  b  aprailrd.  Wbn  aB  iV  kaat  apal  b  ibn.  the  Can 
(Tabard  Cpbadrr  b  Jinphiad  aad  lha  kaaaa  raa  dn  ba  aond  d  Ihb 
rtagr-  Figan  13  dMoni  tba  lU^daprd  Caarrabird  Cpibdrr  ia  Icfaa  d 
twn  rran  a  rtian  A*  Uua  npitrai  ibm  ana  w  nap  ia>raad  ffaphin 
iMnimn  nad  ban  il  a  anllca  ta  Lbp  roiird  Snrma  Lap  (aba  amt 
icrapiua  intbapa  arr  aciltra  ia  (').  it  lohra  ma  bmg  ira  iral  lian  ailrr* 
nrunu  d  morag/ Inwadonainf  (n-nmiliard  Cplinilm  on  oHt  ilbpinpcd 
viili  biililro-iiao  irmuird.  TiicrWurr  milp  run  mUim  nn  libpiapid 


Flgara  Ti  30  paum  toambd  bp  raba  rnaaaaib 
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utflni  at  •  Ge»crili«a  CylmOer  while  the  Cenetmiuea  CtBb^  • 
Mitf  htlcl.  DoimIo,  hitlda-liM  ie««»»«l  ■  eo*  Dieeufy  a  ing  w 
the  siwce  hae  dnwmg  ■  eaed  •  then  ■  »•  enihigttity  ci  10  Mnctm 
in  the  eurae  bae  diawa»  Flgwe  U  ihowa  Gaaenhiad  Cyliatke 
■ctiptnaa  teaaaleg  by  the  eyaua  after  aU  the  Itbag  operaMaa  «• 
*— *— » 

AJtbanah  might  he  eceanae  aoagh  for  laaal  parpoace  (The  e^ 
taal  Mc  the  put  ■  ItauaeUauBi  Iftaaij,  the  Cetterahieri  Cyliate 
dramptaeae  woaU  hat*  baaa  aae  aceante  i  we  had  aeaeaiad  rimma 
pataamtai  mma  eceatatelp. 

It  lahee  ahoal  thna  or  foar  auautae  to  It  oaa  GearraKted  Cyli» 
dee  with  faae  knoa.  thoagh  the  ptnblema  at  dieplay  time  eud  30  iapal 
acranry  had  to  be  iniTal.  The  total  time  re«|nmd  to  It  Geaanh 
iaed  Cyliadem  to  all  the  aabparli  d  aa  ohyert  depeadi  oa  how  maap 
•abparti  a  haa.  Pee  aumplr,  d  the  ohjecl  a  foemed  by  two  or  thraa 
Mthpane.  tea  mmalae  aoahl  hr  caough  foe  btiddiug  the  model  at  the 
objatt.  With  thic  aeei  fihuiUy  iaicrlaee,  ore  a  peraoa  aha  a  aot  a 
cempalcr  opmt  eaa  keani  bom  to  badd  oiodeh  eoeiiy  aud  eaa  bodt 
them  amply  aad  taKkly  aitlmat  eefaea. 


the  am  elep  toaanit  the  pouetfal  modrUag  •y.iem  ahich  eaa  1..-^,^ 
both  faactmaal  «d  geuaietne  faatana.  the  itameinc  mmleliag  eymam 
dtaoibad  hare  a  dmigatd  la  baiid  modch  <d  objatu  which  eta  be 
dmenbed  by  fmaetne  ftatarm.  Tha  tyurm  aad  the  ACttONYM 
eymam  do  aot  yet  haadk  faactiOBal  aad  loehar  geametne  laanrm. 
They  woaJd  baceme  meet  ptm-mfal  if,  m  Fntafe,  they  could  i.^ndW 
thM 


|1|  Drooks.  JUtsmmmf  S-D  P4o4»la  mid  t-Q 

Ph  O-  Tbcta  AJJ4>343.  DcpvtBM  rtf  CofBpvur  Scieac*. 

SuAfurtf  UAiT«>«t7,  Staifnrrtg  CAltfoma,  Jua  iMI. 

(3|  Danacart.  DC..  Gtmmmtni  M^deknf  far  Comp  iff  Pb.D. 
TbcM»  AJM>349.  Deparaat  d  Computer  Sciasca,  SuoforU  Uai- 
roiiiy,  Suaibrtf,  CjhUformuk  Octubm  i9T4. 

[9|  BiAferd.  T  O-.  VuW  PrrrtpTtM  kf  etm^rnttr.  Proc.  fCTg  Coal. 
OA  Syutma  Mitf  CoAttni,  Maaxai,  rnrumha  1971. 


t.  Casclwlm 

Tha  St«wo  ModrliAf  Sputum  whick  cttAblm  Moipla.  tmn  mndd 
buikiiAg  v«P  deKnbotf.  TW  key  ideM  berr  iwc  tbr  fcjUawiaii:  |1)  buU 
a  aoiki  d  ua  ok|eet  wmUmtr  from  a  30  cxiuaplr  <tf  tlir  rtfjieet.  (3) 
kara  lii#  dam  model  <tf  tke  uk^ett  frtmi  ouuaplot.  Thia  tjuem  m  aaap 
to  Irara.  i.e..  roam  a  pmao  oIki  a  oot  a  couipatfT  eaa  maalar 

It  m  aa  boor  or  m  aad  tonririi  d  3D  oh^rru  <*au  Ke  hudt  raadf  aad 
(roKklT'  r  g..  a  model  <tf  a  lamplr  abject  oitb  two  nt  tiiiee  parta  eaa  ba 
baiii  ui  10  aunauu  oiUioot  ermra. 

Aitlmiigb  tlir  fifThldri  <tf  tkr  arrumry  Uie  mmlrUug  via  aohmd 
by  the  Muau  fiii*ci*rii  aad  the  3D  poiiiirr  erui  hr  itiivrd  ta  30 

«parr  vitlim  «a«r  pad  ttf  ibr  ftirrro  imagr^.  tiia  iimmItUqi  ouglit 

Dot  hr  Muu*il  tUr  lugkiy  arcarate  umhIi  bug  <tf  ro<ri|ibratr<l  <4ii<rta. 
HoFwrvcr.  the  aapbnty  ntber  tbaa  the  hjgh  aemnhey  30  modal 
(ieacfjpcioaa  a  aaportaat  m  Imafe  UodL-ntaaduBf  Evro  v«  doo't  hava 
acoume  30  aodek  d  ohjoeu  m  the  world  m  our  Kraioe  Aithoufb  tba 
3D  inoUeb  vhKb  tlua  eytcam  producea  might  oot  be  ruited  for  CAO  or 
Computer  Orapkuca  m  vbich  a  bich  Jevrer  d  arcur  hcy  a  laportaat, 
they  arc  heberod  to  ba  accurate  mougli  for  moat  appbratiooa  m  oaaca 
uuderataadiag. 

It  would  be  ideal  tf  30  modek  wrre  budt  autumaiKaily  wiiboat 
airy  aid.  How^m.  it  m  aCjil  dificult  tu  buud  uac/ui  30  modeb  for  Iinac» 
Uodrntaadiag  fully  aatamaticaUy  la  Uua  ryctrm.  tbc  exampk  of  lha 
ohjt’ct  ■  divided  mUi  pi^ta  arcnrding  to  the  rrqoircd  accttracy  baaed 
uii  luuiiaa  jodgcuinii  luid  fcnuirtru  h-aturee  of  the  n)«jcet  arc  taufbt 
aud  d<*prnbed  eftnmtly  naiog  tbc  ku<Twlcdge  of  the  ohjoct  ve  bauu 
Motirb  ran  br  Hudt  from  ooe  ncrevi  |Mur  for  we  kuow  Uial  tbna  •  oo 
taii  m  (hr  iuddeo  part  of  tbc  object  Hnwmrrr  >«  fully  ■uitoraatK  tyhtem 
widiout  ^ucii  koowirdgc  rrqiurrv  ptrturhs  of  thr  ohjeet  frao  ail  diffcreal 
aiigjr*  Nrvmhchur.  it  m  true  that  ui  our  ftyAteto.  a  •trrro  puff  from 
a  (pHMl  viewpoint  m  iiixdnl  and  wrrid  iwtrrro  p«ur«  iruKht  be  rrqairod 
for  a  complicated  «jli)«Tt.  it  m  piwaiiik  to  riintumr  iHuidiag  the  modal 
frtaa  dilfcrrui  aoglr*  tf  camera  paramcien  are  knuva  aud  tkia  may 
br  fuvfOftary  lu  futrire.  Buwiwrr.  llir  key  idra  Urrr  o  to  kmid  madtU 
fkrtetlf  la  SO  rpacc  aom#  artaal  esampdrr.  i  r  .  30  space  ooed  not  ba 
•trrro  imagm  aad  rtetamcopa.  It  ■  alan  poaaihlc  to  6c  Gcocrakaad 
CyUiiilrrp  omag  kuota  m  artaaf  30  eparr  na  a  30  iimriter  like  a  robot 
aria  TUio  type  of  alieruattua  airtbod  miabl  br  uwtfuJ  if  a  good  30 
potatev  a  avadabk. 

Some  claaaea  ttf  obirru  haw  vunona  grooirtnc  uAtaneea  aad  tbay 
are  Kwi  draenbed  l»y  fuoruonalfrattimi  and  luubrr  gc^auctrK  fcoturaa.* 
Ou  Uir  nthrr  IuuhI.  tliiTr  ■  aiiiuher  rliwa  itf  <4ijct(s  wlucb  eaa  bast  ba 
drwrrilMil  liy  grtmirtrw  fmlurr*  and  m  •hilinih  Ui  tliwribe  liy  funrtmoal 
fratnrru.  e  g  .  tbcrr  p  mi  moii  with  tlf  lef»  aud  wlwU  iwr  the  fiuictmcial 
fmturw  gf  a  mao  '  Alan  tluTP  m  a  rhow  d  idijieu  vluch  can  ba 
tkwrilMil  l*n«b  faurtuutady  and  grtoiirtrwally.  r  g  .  irnoM  balk  am 
*dwajrt  omnil.  unU'lKMiko  are  lertMiignlar.  aud  they  hnvr  functuma.  Aa 


|4|  Nfwmaa.  W  N.  aad  Sprwfl.  11^.*  /Viactpftr  o/  inurmttm  Coow 
pmer  CmpAmr  McGnm-HiU,  Mew  York,  1970,  pp.  IS^l&S. 

|9|  Slama.  C.C.  (ed.),  Mammd  of  PkoUpanmMli g.  AmarkaA  Soesaty 
of  Pbotogrammauy,  kdaryiaAd.  lOM 

|#|  Daka,  B  B..  Dutford.  T  O..  Malik,  J.,  aad  McQer.  J.P..  Pm>fvvM 
»a  Jtferto  itfoomaa.  •''roc.  (nuga  UademtaAdiag  Oforkakop,  Ax* 
Uogvm.  VirguuAi  dBAO  33. 

(7)  Mkiiakki.  IL5..  Carboaml.  J  G  .  aad  MitcbclL  T  M..  Vackaa 
Uanuag.  Tioga  Pubkakiag  Co.,  Palo  Alto.  1993. 

|9|  WiaatoA.  P  H.,  Dlafmd.  T  O.  Kaia,  0..  aad  Lowry,  M.R.,  Umr^ 
lAf  PAgawal  PtMvipcaoo  /ram  Puartiaoal  Dtftmkama.  Riampkr 
.  aad  Prrerdraia.  MaCamal  CoBfarcaea  oa  AxuAdal  fattaUigamea. 
Waakagtoo,  0  C  .  1983.  pp.  433-439. 
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Appendix  F 

ASTERIX:  STEREO  MATCHING 


ASTERCC  (A  Stereo  Image  system)  has  been  partially  implemented  both  as  part  of 
a  general  vision  system  in  succession  of  ACRONYM  and  as  part  of  the  vision  system  for 
a  mobile  robot.  The  vision  system  has  to  handle  stereo  pairs  as  well  as  motion  sequences 
and  should  be  able  to  incorporate  depth  clues  from  other  sensors.  ASTERIX  is  a  general 
system  which  can  be  used  for  the  following: 

•  pairs  of  stereo  images 
-  motion-sequences 

•  generation  of  image  descriptions  which  can 
be  understood  by  the  high  level  system 

Feature  Based  Approach  to  the  Correspondence  Problem 

Both  motion  and  stereo  vision  have  the  correspondence  problem  in  common.  The 
correspondence  problem  in  the  two  domains  differs  only  in  the  tv  •  of  the  constraints 
which  can  be  applied  to  solve  the  problem.  The  main  task  however,  selecting  features  in 
all  frames  of  a  motion  sequence  or  a  stereo  pair,  is  the  same.  That  is  why  the  ASTERIX- 
system  is  based  on  a  general  correspondence  algorithm  which  can  be  applied  to  motion 
sequences  as  well  as  to  stereo  pairs. 

Specialised  knowledge  about  disparity  constraints  is  kept  in  separate  program  modules 
(constraint  sources),  which  evaluate  e.g.  epipolar  lines  (stereo)  or  velocity  predictions 
(motion).  These  separate  constraint  sources  provide  also  an  easy  way  to  feed  constraints 
derived  from  other  kinds  of  sensors  into  the  system.  Thus  a  change  in  robot  configuration 
affects  only  the  constraint  sources  and  the  rules  how  to  apply  them,  but  not  the  general 
concept  of  the  system. 

Another  advantage  of  this  system  structure  is  that  in  the  case  of  motion  sequences 
the  constraint  sources  can  change  according  to  the  knowledge  acquired  so  far.  In  the  first 
frames  of  an  image  sequence  only  very  general  heuristic  constraints  can  be  used,  but  as 
more  and  more  about  the  scene  is  known  more  sophisticated  constraints  can  be  applied. 

Matching  Strategy 

By  grouping  and  grading  of  features  the  matching  process  can  be  guided  by  a  plan  to 
deal  with  ambiguous  feature  constellations  in  an  ‘intelligent*  way. 

ASTERIX  first  inspects  the  feature  constellations  in  both  frames  and  plans  a  matching 
sequence  which  seems  to  be  the  most  promising  for  the  situation.  Three  levels  of  features 
are  available  for  matching: 

1.  Simple  local  features  are  likely  to  be  abundant  and  present  in  both  (or  all)  images. 

They  can  be  computed  in  near  real  time  using  convolution  hardware.  But  they  are 

likely  to  be  indistinguishable  from  each  other. 
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2. 


Larger  derived  local  features,  such  as  lines  and  their  junctions,  are  less  abundant. 
They  also  have  richer  descriptions,  which  reduces  the  number  of  possible  matches. 
Also  items  like  T-junctions,  which  might  be  caused  by  occlusion  may  be  excluded. 

3.  Higher  level  features,  possibly  describing  an  entire  object,  are  easily  matched.  But 
they  are  likely  to  be  distorted  by  occlusion,  perspective  or  illumination.  E.g.  if  only 
three  comers  of  a  square  are  visible  the  square  can  not  be  matched,  but  the  comers 
can. 

The  matching  strategy  takes  the  abundance  of  features  into  account.  Consider  for 
example  the  image  of  a  checker  board:  All  comers  in  the  inner  part  of  the  board  have 
look-alike  neighbors.  Any  matching  strategy  based  on  optimising  a  similarity  measure 
within  a  local  neighborhood  is  bound  to  come  up  with  ambiguous  matches  or  worse,  will 
force  an  arbitrary  decision  and  select  the  best  match  according  to  the  similarity  measure, 
which  might  depend  purely  on  the  noise  in  the  image.  Matching  strategies  based  on  a 
global  optimisation  criterion  on  the  other  hand  have  the  tendency  in  case  of  ambiguities 
to  force  some  wrong  nutches  for  the  sake  of  a  globally  better  optimisation. 

ASTERDC  uses  a  different  strategy:  The  system  first  scans  both  frames  independently 
and  groups  the  features  into  classes  of  similar  features,  which  might  cause  ambiguities.  In 
the  case  of  the  checker  board  ASTERDC  would  see  immediately  that  there  are  lots  of  look- 
alike  comers  in  the  inner  parts  of  the  board,  but  that  the  four  comers  of  the  board  itself  are 
unique.  So  the  system  starts  matching  by  matching  one  of  these  unique  comers  first.  Then 
the  neighboring  comers  are  matched  by  following  the  edges  that  connect  them,  until  all 
parts  of  the  image  are  matched  or  no  more  constraints  can  be  derived.  Ambiguities  which 
cannot  be  solved  at  this  stage  of  analysis  are  forwarded  to  the  higher  levels  of  analysis, 
rather  than  forcing  a  decision  based  on  low  level  clues  only. 

The  way  ambiguities  are  solved  in  ASTERDC  is  related  to  graph  matching  techniques. 
Both  strategies  are  feature  based,  evaluate  all  possible  ambiguities  and  derive  constraints 
from  structural  knowledge  like  neighborhood  relations.  The  difference  is  that  graph  match¬ 
ing  strategies  compare  features  between  the  frames  to  be  matched  whereas  ASTERDC 
groups  the  features  and  compares  them  mainly  within  the  frames.  Graph  matching  is  very 
mechanical  whereas  the  grouping  generates  a  plan  for  a  data-driven  matching  sequence. 

The  planning  of  the  matching  sequence  in  ASTERDC  can  be  compared  to  the  way 
a  child  tries  to  solve  a  jigsaw  puzsie.  Usually  the  child  will  start  with  pieces  that  catch 
the  eye  because  they  are  strikingly  different  from  all  other  pieces  in  either  shape  or  color, 
and  the  more  advanced  child  will  organize  his  pieces  and  sort  them  according  to  color  and 
shape. 

Feature  Extraction  and  Image  Description 

Points  of  interest  and  edge  elements  are  the  basic  features.  The  edge  appearance  model 
is  used  for  edge  detection.  It  takes  the  point  spread  function  used  for  image  generation 
into  account  and  is  capable  of  locating  an  edge  with  up  to  1  /8  pixel  accuracy.  Therefore 
good  edges  can  be  located  with  pixel  accuracy  in  an  image  reduced  by  a  factor  8,  thus 
resulting  in  a  speed  gain  by  a  factor  of  64.  The  rich  edgel  description,  i.e.  quality,  position, 
direction,  left  and  right  grey  levels,  results  in  relatively  unique  stereo  matches  even  at  the 
edge  1  level. 
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Feature  generation  and  image  descnption  proceed  in  7  stages: 

1)  A  set  of  gradient  operators  is  applied  to  the  whole  image.  Pixels  above  a  threshold 
are  marked  as  candidates  for  the  edge  or  point  of  interest  operator. 

2)  At  the  first  unprocessed  location  the  edge  operator  is  applied  (without  its  early  stage, 
which  is  the  gi^ient  operator).  If  successful  the  area  is  marked  processed  and  pre¬ 
dictions  for  the  next  location  are  generated. 

3)  The  edge  operator  is  applied  at  the  predicted  locations,  thus  tracking  the  edge.  The 
quality  threshold  is  set  very  low  in  order  to  negotiate  comers,  thereby  avoiding  the 
search  for  a  new  starting  point. 

4)  The  resulting  string  of  edge  I’s  are  broken  into  pieces  with  sufficient  quality.  These 
are  further  segmented  at  points  of  change  of  curvature,  left  or  right  grey  level. 

5)  Second  level  features  •  line  descriptors  •  are  computed. 

6)  The  ends  of  lines  are  extrapolated  in  accordance  with  the  edge  model.  Where  ends 
of  lines  cross,  third  level  features  junctions  are  generated.  Prerequisite  for  a  junction 
is  that  participating  lines  intersect  at  one  point  and  grey  levels  match  locally  Thus 
partial  junctions  (one  grey  level  match  missing)  classes  of ,  .:t.ons  e; 

-  L-shaped  comer 

-  continuation  (L  with  180  degree  angle) 

-  Y-junction 

-  T-junction 

-  arrow  junction 

-  star  (4  lines  meeting,  various  subclasses) 

-  partial  junction  (inner  L,  outer  L,  suspected  T,  etc.) 

Line  descriptors  are  updated  with  the  exact  location  of  their  endpoints  cr  merged  in  the 
case  of  "continuation”.  The  network  of  lines  and  junctions  and  associated  labels  constitutes 
the  image  description  forwarded  to  the  high  level  reasoning  system. 

7)  The  point  of  interest  operator  is  applied  to  the  remaining  candidate  locations.  It 
labels  the  points  of  interest  as  dark  objects  on  a  light  background  or  vice  versa  and 
computes  also  the  orientation  of  the  comers  and  a  measure  of  quality. 

Grouping,  Grading  and  Matching 

The  features  are  grouped  into  equivalence  classes.  Matching  takes  place  between 
classes  of  features  rather  than  between  features  themselves.  The  first  step  of  matching  is 
grading  of  the  classes  according  to  abundance  and  prominence  of  features.  The  matching 
sequence  is  determined  by  the  grades  of  the  classes.  The  classes  with  only  few  but  very 
prominent  features  (high  contrast)  are  matched  first  to  get  reliable  and  unique  feature 
matches.  FVom  these  initial  matches  new  constraints  are  derived  and  propagated  into  the 
more  ambiguous  classes.  The  constraint  propagation  follows  the  edges  which  connect  the 
comers  and  junctions. 


The  grouping  and  grading  of  featuree  does  not  necessarily  reduce  the  computation 
time  for  the  matching.  The  comparison  of  features  within  the  frames  takes  about  the  same 
time  as  the  comparison  of  features  between  the  frimes,  but  the  grouping  process  saves  the 
results  of  the  comparisons  in  a  more  useful  way,  so  that  a  plan  can  be  derived  to  solve 
ambiguous  constellations. 

Implementation  and  Results 

TV  cameras  are  connected  to  a  SUN  workstation  enhanced  by  image  processing 
boards.  The  image  processing  hardware  is  capable  of  frame  rate  pixel  operations  and 
does  subsampling,  averaging  and  gradients.  Edge  operator,  edge  follower  and  interest  op>- 
erator  are  implemented  in  C,  all  other  parts  of  the  system  are  running  in  SLISP,  a  flavor 
of  COMMON  LISP. 

The  feature  extraction  and  the  grouping  and  grading  of  features  have  been  testec 
real-world  scenes  (machine  parts,  telephone,  country  road)  with  quite  satisfactory  resu 
Preliminary  matching  results  were  obtained  for  the  country  road  pictures. 
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Appeodlx  G 

ACTIVE  OPTICAL  RANGE  SENSING  POR  ROBOTS 


I.  Introduction 

Active  optical  range  sensors  can  have  useful  applications  with  mobile  and  fixed  robots. 
Compared  to  passive  sensing,  active  sensing  reduces  the  complexity  of  information  process¬ 
ing  required  for  perceiving  the  environment.  Immediate  concerns,  such  as  the  presence  of 
obstacles,  may  be  addressed  quickly  without  the  need  for  advanced  image  understanding 
techniques. 

This  report  will  examine  the  characteristics  of  two  types  of  ranging  sensors.  The  first 
are  those  which  measure  range  by  triangulation  as  in  stereo.  They  measure  the  angles 
of  the  illumination  source  and  its  image.  Some  are  known  as  structured  light  systems 
because  they  cast  a  pattern  of  light  on  the  scene  and  sense  the  image  positions  of  the 
light  pattern.  The  second  class  is  LIDAR,  which  measures  time  of  flight  of  a  light  beam 
either  by  measuring  round  trip  time  directly  or  by  measuring  phase  angle  of  a  reflected, 
modulated  beam. 

II.  Sources 

Sources  fall  into  two  general  classes,  incoherent  and  coherent  (usually  lasers).  Inco¬ 
herent  sources  offer  high  power  at  low  cost  in  the  form  of  arc  lamps  and  flash  tubes.  Flash 
tubes  measuring  a  few  inches  in  length  can  produce  pulses  of  several  kilojoules  at  up  to 
SOincoherent  sources  may  only  be  used  with  triangulation  ranging  since  powerful  source 
types  cannot  be  temporally  modulated  with  short  enough  wavelengths  to  be  of  interest  in 
robotic  situations.  Another  difficulty  of  incoherent  radiators  is  fundamental,  they  cannot 
be  easily  focussed  into  a  small  beam  of  low  divergence.  This  leads  to  poor  depth  of  focus 
with  structured  light  patterns.  When  operating  outdoors,  incoherent  sources  can  have 
difficulty  competing  with  sunlight.  By  contrast,  laser  signals  can  be  discriminated  from 
sunlight  with  the  use  of  dielectric  interference  filters  or  by  modulation  of  the  source. 

Laser  sources  offer  much  as  radiators  in  range  sensing  systems.  They  may  be  easily 
focussed  into  small  beams  of  low  divergence  or  projected  in  patterns  with  very  large  depth 
of  focus.  Further,  they  may  be  modulated  at  wavelengths  suitable  for  robotic  range  mea¬ 
surement.  In  fact,  it  is  feasible,  though  expensive,  to  measure  absolute  range  directly  to 
sub- micron  accuracy  over  several  meters  using  advanced  laser  systenos. 

The  advent  of  the  stabilized  laser  source  has  made  practical  the  treatment  of  the  laser 
in  the  manner  of  a  radio  or  radar  signal,  rather  than  as  just  a  directable  heat  source.  Using 
doppler  techniques,  velocity  or  surface  vibration  may  be  sensed. 

FVom  the  point  of  view  of  radiator  power  available,  C02  lasers  are  very  attractive. 
They  may  be  stabilized  effectively,  and  can  radiate  optical  power  into  the  kilowatt  range 
continuously.  With  heterodyne  detectors,  C02  laser  signals  may  be  detected  at  the  photon 
noise  limit  at  very  low  levels  of  detector  illumination.  Because  of  the  relatively  long 
wavelength  (10  microns)  the  photon  statistics  are  better  than  those  of  visible  lasers  for 
comparable  power. 


Disadvantages  of  C02  laaer  systems  include  cost  of  the  laser,  high  cost  of  10  micron 
optics,  high  cost  of  detectors  (which  normally  need  to  be  cryogenically  cooled)  and  the 
difficulty  of  alignment  which  comes  with  heterodyne  photodetection. 

For  very  high  bandwidth  environment  sensing,  a  C02  based  system  would  be  difficult 
to  surpass,  as  far  as  performance  is  concerned.  Small  sealed  waveguide  C02  lasers  and 
electronically  cooled  detectors  will  make  advanced  long  range  vehicular  systems  feasible. 

An  advantage  of  C02  systems  is  that  for  a  moderate  power  level,  C02  laser  radiation 
is  less  hasardous  to  personnel  than  laser  beams  in  the  visible  spectrum,  as  it  will  not 
penetrate  the  cornea  to  bum  the  retina,  as  visible  laser  radiation  will.  As  far  as  safety 
is  concerned,  C02  radiation  has  the  disadvantage  of  being  invisible.  This  might  be  an 
advantage  in  military  applications.  Also,  the  high  power  of  C02  lasers  increases  risks  of 
intense  exposure. 

Helium  neon  lasers  are  available  as  inexpensive  radiators  at  moderate  power.  Very 
cheap  lasers  are  available  with  power  in  the  milliwatt  range.  With  careful  attention  to 
signal  detection,  this  can  be  enough  for  practical  use  in  robotic  environments.  Larger 
units  are  available  with  power  to  hundreds  of  milliwatts.  HeNe  lasers  may  be  stabilized 
and  used  in  doppler  systems.  It  is  possible  to  stabilize  a  HeNe  laser  running  two  cavity 
modes  which  provides  effective  modulation  in  the  GHz  range. 

Solid  state  lasers  are  available  commercially  with  powers  in  the  tens  of  milliwatts  which 
may  be  directly  modulated  at  wavelengths  useful  in  robotic  applications.  Advantages  for 
these  units  over  gas  lasers  are  their  small  size  and  ruggedness.  One  disadvantage  can  be 
the  need  to  use  beam  collection  and  concentration  optics. 

YAG  lasers  can  be  used  in  systems  measuring  time  of  flight  directly  by  measuring  the 
transit  time  of  pico-second  pulses. 

Other  lasers  which  might  be  suitable  for  robotics  applications  include  Helium  Cad¬ 
mium  lasers,  which  are  siriiilar  to  Helium  Neon  lasers  while  offering  more  power  at  higher 
cost. 

III.  Sensor  Systems 

The  detection  system  is  as  important  as  the  source  in  an  active  optical  ranging  system. 
Noise  characteristics  have  a  strong  impact  on  the  operating  range  and  radiator  power 
needed.  The  main  types  of  detectors  in  use  fall  into  the  classes  of  solid  state  photo¬ 
detectors,  photo-multipliers,  and  heterodyne  systems. 

The  criterion  of  merit  is  whether  the  detector  is  pboton-noise-limited  ai  the  typical 
received  power  with  which  the  system  will  operate.  A  system  will  be  photon-noise-limited 
if  the  shot  noise  due  to  the  photon  &ux  of  the  received  signal  is  the  dominant  noise  in  the 
detection  system  (over  thermal  noise,  etc..). 

It  is  possible  to  approach  the  quantum  noise  limit  at  reasonable  power  levels  using 
either  photo-multipliers  or  heterodyne  photodetection.  Solid  state  photosenssors  are  typi¬ 
cally  limited  by  thermal  noise. 

Solid  state  sensors  are  available  as  array  sensors  (e.g.  CCD  television  cameras)  and 
as  analog  position-sensing  devices,  where  several  cathodes  share  the  same  photodiode  and 
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the  position  of  the  beam  falling  on  the  sensor  is  inferred  by  the  ratios  of  photo  currents 
among  cathodes. 

Area  sensors  are  limited  in  bandwidth  by  their  scan  frequencies  to  the  audio  range. 
Position-sensing  photodiodes  are  bandwidth  limited  by  their  large  capacitances  to  the  low 
megahertz  range. 

Single  photodiodes  and  modem  photomultipliers  using  micro-channel  techniques  are 
available  with  bandwidths  to  several  GHz,  making  them  practical  in  systems  based  on 
phase-detection  of  a  modulated  light  source. 

Heterodyne  photodetection  systems  are  capable  of  operating  at  the  quantum  noise 
limit  with  comparatively  low  detector  fluxes.  Their  disadvantages  include  the  cost  of 
generating  optical  local  oscillator  and  the  necessary  alignment  of  the  signal  and  local 
oscillator  beanas  on  the  face  of  the  photo-detector.  Heterodyne  photodetection  is  practical 
for  quantum-noise-limited  detection  of  weak  C02  laser  signals.  Photomultipliers  do  not 
respond  to  C02  radiation. 

rV.  Sensing  System  Strategies 

In  order  to  be  of  use  in  range  determination,  the  emitted  radiation  must  be  patterned 
either  temporally,  as  in  LIDAR  systems,  or  spatially  as  in  structured  light  systems.  We 
will  first  discuss  structured  light  systems. 

One  way  of  classifying  structured  light  systenaa  is  according  to  the  style  or  patterning 
of  the  radiation.  The  most  commonly  used  patterning  method  has  been  “light  striping*,  in 
which  a  planar  sheet  of  light  is  scanned  through  an  angle  over  time.  With  an  image  derived 
from  an  imaging  sensor,  it  is  then  straightforward  to  determine  range  by  trianulation.  The 
imaging  sensor  may  be  an  ordinary  video  camera  attached  to  a  frame  buffer.  Solid  state 
area  sensors  are  often  used  because  of  their  inherent  geometric  accuracy.  A  limitation  for  a 
system  of  this  sort  stems  from  the  need  to  digitize  a  large  number  of  images  to  capture  the 
sweep  of  the  light  sheet  through  enough  angles.  For  example,  if  a  horizontal  resolution  of 
100  is  desired,  then  100  frames  of  video  will  be  required  to  obtain  a  dense  depth  map.  This 
sort  of  measurement  strategy  has  been  used  in  commercial  robotic  range  sensing  systems. 

A  variant  of  of  this  scheme  involves  basically  the  same  strategy  restricted  to  two 
dimensions.  In  this  case,  the  radiator  emits  a  beam  rather  than  a  sheet  of  light  which  is 
swept  through  an  angle  over  time.  Here  a  linear  sensor  is  needed.  For  this,  position  sensing 
photodiodes  may  be  used  [Lemarquand].  These  sensors  allow  for  relatively  simple  analog 
electronic  signal  processing.  For  3-d  sensing,  this  2-d  system  may  be  scanned  through 
another  angle.  Yet  another  variation  here  involves  the  use  of  a  photo-multiplier  tube  in 
conjunction  with  a  rotating  mirror  as  the  detector.  This  scheme  was  used  by  [Pipitone  83j. 

Other  methods  possible  for  structured  light  ranging  include  “gray-scale”  structured 
light,  and  “bar-pattem-sequence”  structured  light.  In  gray-scale  structured  light  one  ra¬ 
diates  several  patterns  as  a  continuous  function  of  the  emisssion  angle.  At  each  location 
on  an  imaging  sensor,  it  is  possible  to  infer  the  emission  angle  of  the  radiation  falling  on 
the  corresponding  surface  point  by  observing  the  detected  intensity  for  each  of  the  several 
radiated  patterns.  An  advantage  of  a  system  of  this  type  is  that  dense  depth  data  could 
be  derived  from  a  small  number  of  emitted  patterns,  perhaps  three.  It  would  be  feasible  to 
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implement  the  signal  processing  portion  of  this  system  using  a  conventional  video  stream 
image  processor. 

Bar-pattem-sequence  structure  light  is  another  strategy.  Here,  a  sequence  of  bar 
patterns  encodes  the  emitted  radiation  angle.  If  binary  encoding  of  the  emission  angle 
were  used,  it  should  be  possible  to  achieve  angular  resolution  of  256  with  a  sequence  of  8 
emitted  patterns.  Alternative  coding,  e.g.  grey  coding,  would  provide  better  behavior  at 
pattern  boundaries. 

LIDAR  SYSTEMS 

The  second  major  classification  of  active  optical  ranging  systems  encompasses  those 
systems  which  employ  time  modulation  of  the  radiation  as  the  pattern  which  is  used  to 
discriminate  range.  Such  systems  measure  range  by  inferring  the  transit  time  from  the 
radiator  to  the  object  and  back  to  the  sensor.  The  transit  time  is  either  measured  directly 
as  in  time-of-flight  systems,  or  indirectly  by  measuring  the  phase  shift  in  the  light  beam 
of  known  wavelength  as  it  travels  from  the  radiator  to  the  target  and  returns. 

Typical  modulation  frequencies  for  such  systems  range  from  the  tens  of  megahertz  to 
thousands  of  megahertz,  with  a  trade-off  between  range  of  unambiguous  measurement  and 
range  resolution.  That  is,  phase  measurements  imply  distance  measurements  modulo  the 
wavelength.  Longer  wavelengths  enable  a  greater  range  of  unambiguous  measurement  and 
less  range  resolution.  Because  of  bandwidth  requirements,  single  photodiode  detectors  or 
photo- multiplier  tubes  are  usually  used.  Small  PM  tubes  using  microchannel  plates  are 
available  with  bandwidths  into  the  GHs  range.  Such  sensors  are  attractive  as  they  allow 
detector  performance  which  approaches  the  quantum  noise  limit,  for  low  signal  power 
levels. 

In  phase  detection  of  a  modulated  source,  there  is  a  practical  limit  on  the  resolution  of 
phase  measurements  made,  typically  on  the  order  of  one  part  in  10,000.  In  order  to  achieve 
high  range  resolution  with  a  large  measurement  range,  one  may  employ  a  hierarchy  of 
modulation  wavelengths.  Measurement  at  longer  wavelengths  is  used  to  determine  which 
“cycle”  of  a  shorter  wavelength  signal  is  being  observed.  Then  the  shorter  wavelength 
measurement  may  be  used  to  obtain  increased  resolution. 

Direct  time  of  flight  measurement  is  possible  using  short  pulses  available  from  YAG 
lasers.  The  advantage  in  cost  and  complexity  over  continuous  wave  lasers  with  phase- 
detection  of  modulated  sources  is  not  clear. 

An  interesting  system  has  been  patented  by  ITEK  which  employs  the  phase  angle 
measurement  of  laser  radiation.  ITEK  exploits  consistency  requirements  of  observations 
at  a  set  of  positions  of  the  target  as  measured  by  several  beanos  separated  in  angle.  This 
system  may  be  seen  as  a  sort  of  hybrid  between  stereo  type  systems  and  phase-measurement 
systems.  Optical  frequency  phase  angle  measurements,  interferometry,  have  been  used  for 
displacement  measurements  as  in  the  Hewlett-Packard  interferometers. 

V.  F^r-field  comparison  of  sensing  strategies 

One  point  of  comparison  for  active  optical  ranging  systems  is  the  asymptotic  behavior 
of  the  system  resolution  at  long  distances.  We  will  discuss  this  behavior  for  laser  systems. 
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Asymptotics  of  current  SNR 

All  systems  have  a  dependence  of  resolution,  or  range  noise,  on  the  current  signal-to- 
noise  ratio.  If  laser  systenos  are  compared,  and  the  received  signal  is  weak  enough  that 
thermal  noise  dominates  quantum  noise,  then  a  good  model  of  the  current  SNR  is  that  it 
is  inversely  proportional  to  the  square  of  the  range.  The  assumptions  here  are  that  the 
detector  sees  the  entire  spot  of  the  beam  on  the  target,  and  that  the  intensity  of  radiation 
arriving  at  the  detector  optics  obeys  the  inverse  square  law. 

Relation  between  phase  resolution  and  current  SNR 

In  phase-measurement  systems,  the  relation  between  current  SNR  and  measured  phase 
resolution  is  important. 

A  phase  measurement  scheme  which  is  particularly  easy  to  analyze  is  one  where  the 
timing  of  zero  crossings  in  the  sinusoidal  signal  is  measured.  Such  a  detector  can  theoret¬ 
ically  be  made  to  have  good  noise  performance  by  using  a  narrow  band  pass  filter  before 
the  zero  crossing  detector.  It  is  easily  seen  that  the  size  of  the  fluctuation  in  the  position 
of  a  zero  crossing  will  be  proportional  to  the  fluctuation  in  the  current  divided  by  the  slope 
of  the  signal  at  the  crossing.  Since  the  slope  of  the  signal  at  the  crossing  is  proportional 
to  the  amplitude  of  the  signal  current,  it  is  clear  that  the  fluctuation  of  the  position  of  the 
zero  crossing  and  hence  the  noise  in  the  phase  measurement  will  b':  versely  proportional 
to  the  current  SNR. 

In  a  phase  detection  system,  the  range  resolution  is  proportional  to  the  phase  res¬ 
olution,  since  range  is  proportional  to  phase.  Because  the  phase  resolution  is  inversely 
proportional  to  current  SNR,  which  is  inversely  propotional  to  range  squared,  we  see  that 
range  resolution  is  proportional  to  range  squared. 

Relation  between  range  resolution  and  angle  resolution 

To  ascertain  the  long  distance  asymptotics  of  structured  light,  i.e.  triangulation  rang¬ 
ing  systems,  we  need  to  determine  the  relationship  between  angular  resolution  and  range 
resolution.  Elxamining  the  case  where  the  range  is  much  larger  than  the  baseline  and  the 
triangle  is  Isoceles,  one  may  approximate  the  baseline  as  the  range  multiplied  by  the  small 
apex  angle.  Since  angle  increments  measured  are  proportional  to  the  apex  angle  (the  factor 
is  -.5)  we  s«e  that  the  measured  angle  is  proportional  to  the  baseline  divided  by  the  range. 
Differentiation  shows  that  the  increment  in  range  is  proportional  to  the  increment  in  angle 
multiplied  by  the  range  squared  and  divided  by  the  baseline.  Thus  for  fixed  angular  reso¬ 
lution,  the  range  resolution  is  inversely  proportional  to  the  square  of  the  range  for  stereo 
type  systems. 

Relation  between  angular  resolution  and  Current  SNR 

The  asymptotics  of  triangulation  optical  ranging  systenos  also  depend  on  the  relation 
between  the  resolution  of  angular  measurements  and  the  current  SNR.  An  easily  analyzed 
detector  for  angles  may  be  arranged  by  imaging  the  distant  spot  onto  a  position-sensing 
photodiode.  Here  the  imaged  spot  position,  and  hence  the  angle,  is  proportional  to  the 
difference  between  two  photo  currents  divided  by  their  sum.  If  the  noise  currents  are  small 
and  comparable,  then  the  angular  resolution  will  be  inversely  proportional  to  current  SNR, 
thus  inversely  proportional  to  the  squzire  of  the  range. 
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Since  we’ve  seen  that  for  fixed  angular  resolution,  the  range  resolution  of  a  triangu¬ 
lation  system  is  inversely  proportional  to  the  square  of  the  range,  and  since  the  angular 
resolution  is  also  inversely  proportional  to  the  square  of  the  range,  we  see  that  the  range  res¬ 
olution  of  this  position-sensing  photodiode  is  actually  inversely  proportional  to  the  fourth 
power  of  the  range. 

Asymptotics  Summary 

For  systems  having  comparable  near-range  performance  there  is  a  disadvantage  for 
triangulation  systems  due  to  their  additional  inverse  square  range  factor  in  their  far-field 
resolution. 

Range  noise  criterion  comparison 

One  way  to  compare  proposed  or  realised  active  optical  ranging  systems  is  by  formu¬ 
lating  a  quantitative  performance  criterion.  This  criterion  should  factor  out  differences 
in  the  experimental  conditions  of  the  measurements  such  as  the  power  of  the  laser,  the 
operating  range,  and  the  measurement  time,  since  it  is  unlikely  that  these  parameters  will 
be  the  same. 

A  measure  of  interest  in  a  ranging  system  is  the  range  noise.  This  is  often  measured 
as  the  rms  fluctuation  in  range. 

Since  averaging  uncorrelated  measurements  will  reduce  the  noise  by  a  factor  of  the 
inverse  square  root  of  the  number  of  measurements,  we  should  multiply  the  rms  range  noise 
by  the  square  root  of  the  measurement  period  to  factor  out  differences  in  measurement 
times. 

Since  the  range  resolution  is  inversely  proportional  to  current  SNR,  we  should  multiply 
by  the  effective  detector  illumination  to  penalize  those  systems  using  stronger  lasers,  or 
else  working  closer  in.  Thus  we  should  also  multiply  the  rms  range  fluctuation  by  the  laser 
power  and  divide  by  the  range  squared. 

Thus  our  criterion  of  comparison  is  the  rms  range  noise,  per  root  hz.  of  measurement 
bandwidth,  times  the  detector  illumination  factor. 

We  will  compare  three  systmes  using  this  criterion.  These  will  be  the  systems  of 
[Lemarquand  83],  [Pipitone  83|,  and  a  hypothetical  system  extrapolated  from  that  of  [Duda 
79). 

Lemarqusmd’s  system  is  a  triangulation  system  which  uses  a  linear  position-sensing 
photodiode  as  the  angular  sensor.  The  laser  power  is  5  mw.,  the  rms  range  resolution  is 
.5  mm.  at  .5  m,  and  the  mesurement  rate  is  64k  measurements  per  second.  Our  criterion 
of  comparison  is  then:  3.9  10~* 

rms  meters  per  root  hz.  watts  per  /  meter  squared. 

Pipitone’s  system  is  also  a  triangulation  system  which  uses  a  photomultiplier  tube 
and  a  rotating  scanning  mirror  as  the  angular  sensor.  This  system  also  employs  a  laser  of 
approximately  .5  mw.,  and  has  a  resolution  of  .25  inch  rms  in  96  inches.  The  measurement 
rate  is  500  Hz.  Our  criterion  of  performance  is  then:  2.42  10~^ 

rms  meters  per  root  hz.  watts  per  /  meter  squared. 
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The  hypothetical  system  we  will  examine  is  based  upon  Duda  et  al’s  system  but 
differs  in  having  the  modulation  frequency  increased  by  a  factor  of  100  from  9  Mhz  to  900 
Mhz.  Such  a  modulation  frequency  is  within  the  bandwidth  of  modem  microchannel  plate 
photomultiplier  tubes.  It  was  pointed  out  above  that  the  ambiguity  arising  from  having 
the  wavelength  shorter  than  the  range  can  be  resolved  by  also  openting  with  a  longer 
wavelength.  The  system  of  Duda  et.  al.  had  a  range  resolution  of  1  cm,  so  we  expect  to 
achieve  a  resolution  of  .1  mm  by  scaling  wavelength.  The  operating  range  was  about  2 
meters,  and  the  measurement  time  was  approximately  .3  sec.  the  system  employed  a  laser 
of  approximately  5  mw  power.  Our  criterion  of  system  performance  is  then:  1.39  10~* 

rms  meters  per  root  hz.  watts  per  meter  squared. 

Vn.  Conclusions 

We  have  discussed  the  basic  types  of  active  optical  range  sensors,  their  radiators, 
sensor  systems,  and  sensing  strageies.  Laser  radiators  are  seen  to  have  an  advantage  in 
daylight  applications,  and  as  radiators  in  phase-detection  systems. 

Triangulation  systems  are  seen  to  have  a  far-field  disadvantage  when  compared  to 
modulation/phase-detection  systems  having  similar  near-field  penc-man 

Three  different  systems  have  been  compared  using  a  quantr.alive  measure  of  per¬ 
formance  which  factors  out  differences  in  measurement  time,  jer  power,  and  operating 
range.  The  three  systems  are  seen  to  have  roughly  comparable  near-field  performance. 

Because  of  the  high  power  available,  C02  laser-baised  systems  could  provide  very 
high  performance  at  high  cost.  Helium  Neon  laser-based  systems  could  provide  good 
performance  at  more  moderate  cost. 
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EFFICIENT  GAUSSIAN  FILTERING  VU  BOXCAR  CONVOLUTION 

William  M.  Wells  HI 

I.  INTRODUCTION 

This  report  eitamines  current  approaches  to  the  economical  computation 
of  Gausaian  Convolutions,  and  presents  an  algorithm  ior  this  computation 
wnich  13  based  on  the  succesive  convolution  of  the  input  image  with 
simple  "bo::car‘‘  functions. 

Con/olution  of  imaqe  data  by  Gaussian  kernels  is  a  popular  operation 
in  i.T.aae  understanding.  Burt  demonstrates  the  utility  of  this  primitive 
i'-!  imjde  data  compression. 

The  approach  presented  here  has  results  equivalent  to  one  of  Burt’s 
'etnpds  (uncer  certain  conditions).  Besides  being  very  efficient,  it  is 
- bu  'oprop"  I  .rte  for  i  .'np  1  enen  t  a  1 1  on  in  hardware. 


II.  Gmussihn  convolution  in  image  understanding 

I-'  -pl-tiC'  p-  UaLipsian  function  amounts  to  low-pass  filtering  pr 

r' 1  -  -  c  .  Put  imadrf.  This  operation  might  seem  contrary  to  the 

-•  1  ■  of  irogc'  .v  c  t  ^  1 1 --nd  1  rg  .  In  their  work  on  edge  detection,  Marr  and 
.  •  -  1  ^  .  ■-  t  i.h t  r-.-n  i  n  :  I  .  .i  t  ur  c  i  ,  cn  get  in 

u'.cge  occLi.'  -<t  various  spatial  scales,  and  that  they  are  best  located 
t.  ■  '  ir.ei  !■'  '  ■■  t  1  r  ;  t  spatial  derivati'.e.  or  equivalently,  by  ceroes  in 
*  it-rsncl  derivative  of  the  low-pass  filtered  image.  Their 

cu'-.r>’  for  ^  ■' uij  I  i.i  i v-mmet  r  s  c  second  derivative  operator  led  them  to 
_ns./S‘.'  tMo  Laplaciun  applied  to  tf«L>  Gaussian  function  of  radius  as  their 
filtr?'"  nr  ops'rAtcjr.  Vhe  sice  (st  andar  d  de  v  i  a  t  i  on  )  of  the  Gaussian  may 
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be  .-oi.'Sted  f:.-  tne  desired  spatial  scale.  Edges  in  the  image  at  the 
chGScn  scale  are  then  marked  where  the  result  of  this  filtering  crosses 
thrc-icn  zero.  These  zero  crossings  form  closed  contours.  Some  kind  of 
thrc'Shclding  is  usually  used,  for  instance,  to  suppress  edge  marking  if 
the  m.tgnitude  of  the  gradient  at  a  zero  crossing  is  below  a  constant 
a  1 1.:  e . 


The  Laplacian  applied  to  the  Gaussian  is  a  "meiiican  hat",  or 
"  c  en  c  er -SLirr  cund  "  type  operator.  For  reasons  of  efficiency,  owing  to 
tne  seoarabil.tv  of  Gaussians  'more  about  this  in  section  III),  this 
operator  is  often  appro:  i mated  as  the  Di f f er ence-Qf -Gaussi ans  of  two 
z  0  j  L  e  s  :  D  G  G )  . 


T^e-a  are  se.erai  reasons  for  the  choice  of  the  Gaussian  as  the 
t'ccthing  f'c.r.ction  to  in  a  scheme  of  this  sort.  Desirable  qualities 

c^  <-■  s'oothinu  tunction  include  effective  low  pass  filtering  and  spatial 
:  c  c  a .  z  n  1 1  o~  .  ■^'-e  Gaussian  ic  w:nict;e  in  simultaneously  optimizing 

I'c  ..t.  1  r,  t  -  :i  . z.-'O  'rec-;-";,  r  3G':.  har'-  ar.j  Hildreth  propose 

t'r'  -■  .. -I ,  - c cs  vnta.  1 1  zn  *' or  .isual  image.",'  is  a  set  of  zero 

z'z''i"'  t  a  :_aolac;a'-'  o*-  Gatissian  cper.stor'  at  hei  r  ar  ch  i  ca  1  1  y 

.  r- -  Ir'-Tt  'T]  cr-  occfcs  <=<  r  e  u  r  e  Sen  t  a  1 1  o.n  which  is  a  i'leirzirchv  of  DGG 
c.;ic;ii.-rel,-'_zd  -C-luS  ron  .jse  in  a  d.^LZ.  cc..Tpr3S5icn 
z'*.  Gr_,.',la,'  CCrcwlev  LTi'  emplo.ed  such  a  r  epr  esen  t  at  i  on  in  his 

"6:-s-za'_-i  in  .  age  u.'  derstanc  i  "  . .  'with  suitable  boundary  conditions, 
t ;  s  t,cu  of  r -?nr  ese,-.  t  a  1 1  on  iz  seen  to  be  complete,  as  the 

r.rv  t:e  r  er  o- c  t  "  _  c  t  ed  e::actly  by  adding  tig  the  components 
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of  the  heirarchy. 


Canny,  in  his  recent  work  on  edge  detection  CCanny  833,  computes 
optimal  edge-operators  for  certain  conditions  which  are  approximated  as 
derivatives  of  Gaussians. 


III.  CURRENT  APPROACHES  TO  COMPUTING  GAUSSIAN  CONVOLUTIONS 

Cne  commonlv  exploited  feature  of  the  Gaussian  function  of  radius  is 
its  seoarabi 1 1  tv  into  a  function  of  x  multiplied  (or  convolved)  by  a 
function  of  For  an  operator  limited  to  an  N  bv  N  non-zero  region  of 

sjocort.  this  recuces  the  cost  of  the  convolution  -rom  to  2N 

r  ■  r.  .  0  1  :  e  =  and  adds. 

accroach  used  in  approximating  the  Gaussian  distribution 
s  r.  -'.IS  fc  Central  Limit  Theorem,  in  that  reoeated  convolutions  by 
s;  d  :=■  t  ^  :  Qi.it  1  on  -  tend  to  approximate  the  Gaussian,  or  Normal 

d  1  s :  - Q  w.  t  1  on  IFeller  Cannv  CCanny  833  exploits  this  to  improve  his 

'  er  '  n ’.  /e  filtsi-  a  n  _  r  a.  i  mat  i  on  of  Gaussian  con-.-ol  uti  on.  The  SLiccessive 
1 :  "  .  1  t :  cn  c  .  1 1,  c  ur  nr- 1  hod  i^je  or  enen  t  beloi'j  is  also  based  on  this 


-  -pie  eu^-npla  of  such  a  scheme  i  s  to  success!  .el  y  convolve  by  tne 
or  L-  d  1  :T,en  s  1  or,  a  1  t  ernel  ‘.1.  1).  This  is  eQuivalert  to  convolving  once  by 
a  o,'  nmia’.  ro  f  r.  t  d  i  s  *.  r  i  Qli  1 1  on  .  Tliese  distributions  have  long  been 

add' o:.  1  .natea  wit!.  Ga.issian  distributions  bv  statisticians  [Feller  57], 

lUii  bino.ni-il  distribution  schea-e  is  apoe,?ling  in  some  conte>:t3  as  no 
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It  isn't  th*  most 


multiplications  are  required  in  the  computation. 
attracti\e,  as  will  be  shown  below,  since  the  standard  deviation  of  the 
resulting  Gaussian  approximation  grows  only  as  the  square  root  of  the 
numoer  of  successive  convolutions  of  the  simple  kernel. 


THE  METHODS  OF  BURT  and  CROWLEY 

Burt  and  Crowlev  develop  similar  methods  for  computing  a  heirarchy  of 
Gauaa  :  an-1  1  kf?  con  vol  u  1 1  on  s  at  exponent  i  al  1  y  related  scales.  Both  employ 
a  venerating  ► ernel "  with  a  small  numoer  of  non-cero  elements, 
typically  Z  by  5  fcr  Z-D  app 1 i cat i ons.  Burt  CBurt  SOI  describes  two 
metnuds  '  H  i  er  a.'' ch  i  c  a  1  Discrete  Correlation"  and  "F’educed  Hierarchical 
Di=C'''=t?  i  at  1  on  '  .  hurt  CZ-'urt  371  expands  upon  the  second  method 

vs  vpplisd  to  efficient  signal  encoding. 

I  .'I's  t'^;o  nV.r.cKlc  )i:ay  be  described  recur  s  i  -e  i  i  as  follows: 


'■■C'  f  d  noi’iCer  cf  tbe  heirarchy  is  tns  input  image. 

'■  c  -.-I'  -It  .T.eniber  cf  tfiO  heirarcnv  is  ccnputed  Ov  convolving 
1-  "rT, cor  '•n.-'rch-  b.  fa  c-'.-''-" 

after  it  has  been  "expanded''  by  a  factor  of  s. 

The  first  member  of  the  hoirarch\'  is  the  input  image. 

The  n'-l'st  member  of  the  heirarchy  is  computed  by  "reducing" 


74 


the  n'th  member  oi  the  heirarchy  by  a  factor  of  %  and  then 
con',  Giving  by  the  generating  kernel. 

In  the  cate  where  »  *  2,  the  expansion  consists  of  inserting  «  zero 
between  each  element  of  the  kernel,  for  example,  transforming  the  V:ernel 
(1,  2,  1)  into  tl,  O,  2,  0,  1).  When  5*2,  the  reduction  amounts  to 

throv-iing  out  every  other  element  of  the  distribution,  for  example,  the 
distribution  (1,  2,  3,  4)  could  be  transformed  into  (1,  Z)  or  (2,  4). 

Pu.-t  examines  the  case  where  s  *  2.  Crowley’s  method  amounts  to  taking 
s  to  be  the  square  root  of  two  and  combining  the  two  above  methods  in  an 
alternating  fashion. 

■'h.^se  metnocs  prnducG  a  set  of  results  closeiv  -  oroximating  the 
c  cn  .  i '^.t  1  cr  c‘  the  input  image  with  Gaussian  k.ernels  having 
e.  erre-r, 1 1  al  1  V  related  scales.  A  heirarchxcal  DOG  reprssentatior  may  be 
had  fc-  suCtractinq  neighboring  levels  in  this  Gaussian  heirarchy. 


CArjrJY'S  mF=F:0ACHES 


f 


,  i,  r discusses  se-eral  interestinc  methods  for  computing 

C'  Ga'.issian  convolution.  One  of  these  is  based  cn 
.  .c-  ar.pir. or  is  au  oidaptation  ot  Icr;., aigov.tn. m 

s  1  mLi  1  tipl  icatiC”. 


Tr,v'  recL.r'fx  e  filtering  method  uses  a  two-pole,  two-cero  (four  term) 
rrci-ir'Si/e  filter  i-mcse  response  is  a  damped  e):ponential  cosine  which 
appro.:  1  mates  >.  me  Gi.Liss  i  .;vn ,  Filters  of  this  sort  have  causal,  or 


75 


one 


-raided,  responses.  To  overcome  this,  he  applies  the  filter  to  th* 
inp-.t  twice,  once  in  each  direction  (for  each  dimension)  and  adds  the 
res-.lts,  obtaining  a  symmetrical  response.  In  order  to  improve  the 
aopr  c::  i  mati  on  to  the  Gaussian  he  usually  repeats  the  procedure  (taking 
ad.sntage  at  tne  Central  Limit  Theorem,  as  mentioned  above). 

A  major  attraction  of  this  method  is  that  the  computational  complexi  tv 
is  independent  of  the  kernel  sice.  For  each  pass  in  two  dimensions,  six 
multiplications  and  additions  are  required  per  pixel.  His  typical  usage 
at  tuo  casses  leads  to  12  multiplications  and  additions,  for  two 
di  tensicns.  i  r, a eo en d on t  of  kernel  sice. 

C:.-"',  also  e.iamines  Strassens  methods  for  fast  multiplication,  with 
ccn.cl'jcicn  ■'cclacing  mu  i  1 1  p  1  i  ca  1 1  on  .  An  ad.-antage  of  this  method  is 
t  ut  It  .Jill  .or;  r  or  general  ;arnels.  .''ot  just  those  which  are 
Gsc '  ac  1  a  e:a-3le).  He  f; -as  speedup  for  some  kernel  sices  by  a 

-  ■  '  **  2  ““  z  y  "f  -  ^  r  .  f'  T-  ^  *3  c  ^  -  s  t  . o  3 1.  o  d  s . 


rv.  CZ^VC^LaTIC^4  BY  BOXCARS 


wr  i  .. 


'utticd  i-js  >ire  presenting  tor  efficient  Gauss  i  an  - 1  i  k  e  convolution 
CO-  o.oto  o-  '-o'0“''tc?'J  1  V  convol  /irq  the  inpuit  bv  "boxcar"  fti.nctions.  The 
. ,  u  ■  0  a  t  t  e  o  ? o '  1  t  a p p r  Cl •  ■  i  n;  t  •? s,  c  on  vcj  I  u  1 1  on.  b  v  the  G au s s  i  an  function 

T.j  ,  Or  seen  .:•£  a  cc.ncequenca  of  the  Centrtai  Limit  Theorem. 
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An  *ttr«.ctive  -feature  boxcar  -functionm  is  that  their  convolution 
mav  be  computed  with  only  two  adds  per  pixel  (no  multiplies)  per 
dimension,  independent  of  their  width. 


In  one  dimension  a  boxcar  function  may  be  defined  as: 

j  O  t  l<  <  N 

where  Nj  is  the  width  of  the  boxcar  function. 


b  -  \ 


The  proposed  method  of  boxcar  convolution  is  described  by; 

where  the  input  di  st' i  buti  on. (  k')  .  s  the  output  distribution,  and  ^ 

:s  t"?  iencth  .r  f  the  bo;;car  function. 


Apol  -ina  the  Z  t r anaf or mat i on  to  (1)  and  using  the  shifting  property  of 
the  Z  transformation  ','ieldo: 

^  r" 

^  T(i'.  =  t 

^  '  n  --  O 

"  1  e 

N-' 

--  Z  I:’' 

r>  1  O 

re::rea3nts  the  transfer  function  of  this  operation.  It  is  also  the  Z 
t-'ariS'orm  of  the  boxcar  function. 

Thus  the  proposed  computation  is  equivalent  to  convolution  bv  a  boxcar 
r'.,nrtiOh.  Th;s  computation  has  been  called  "updating"  by  Binford. 
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T^,^s  IS  easily  demonstrated  by  examining 

'■from  2:.  using  the  binomial  theorem, 

«-  {■^\  ^ -Ci""  jl 

u^  =  SI, )  1  J 

*  m-i  J 

and  taking  the  inverse  2  transform. 


I  . 

Note  that  in  (4)  refers  to  L  convolved  times,  not  raised  to  the  H 

m-i  '  m** 


power  as  with  \A 

m., 

From  (2)  we  mav  write 

u.  m  *1  ^ 

Taking  the  inverse  Z  transform  and  using  the  convolution  summation 
property  of  the  2  transform  results  in: 


L,  C<^  ^  2  \d„., 


istituting  (4)  leads  to 


^ s  s  (.-,2-')  h;..,  (t-L^ 


'C  -  ■s  i'") 


ihe  identification  of 


--  r  Scic') 


0^  as  this  mav  be  written  as  follows. 

J  S'" 


'nis  recurrence  relation  describes  the  family  of  kernels  whose 
c  o-  .  o '.it  1  ons  are  c-qui.alent  to  j',\_  successive  convolutions  bv  a  boxcar 

n  ri 

c  ^  width  ^ 
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If  the  free  parameter  is  chosen  as  follows: 


In  Burt’s  scheme,  varying  the  parameter  *'a"  affects  the  Gaussian 
appro,'<  1  mat  1  on  characteristics  of  the  equivalent  kernels. 

One  criteria  for  choosing  “a"  is  minimization  of  spurious  <in 
comparison  to  Gaussian  kernels)  high  frequency  responses  in  the  power 
spectra  of  the  equivalent  kernels-  Carrying  out  this  minimization 
reduces  the  pear  value  of  the  spurious  loses  to  t  OP.  Pelow  the  D.C. 
response . 

With  'a"  chosen  as  in  <5) ,  the  case  where  Burt’s  method  corresponds  to 
curs,  the  undesired  responses  are  down  by  53  db .  . 

Thus  in  the  above  sense  our  method  isn’t  as  ootimal  as  Burt’s.  In 
applications  with  real  signals  or  images,  however,  the  difference  is 

minor. 


bl  5C.^oSiat'J  OF  CONriNUiTf 


The  equivalent  cor. vclLition  te'^nels  wh ich  result  from  convolutions 

:n: cars  of  sice  h  aro; 

b 

r 
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The  continuity  of  these  •functions  m«y  be  studied  in  the  context  of 
their  non—d  1 '5cr ete  analogs,  that  is.  in  the  limit  that  the  sample  spacing 
goes  to  zero,  with  the  width  being  held  constant.  The  continuous  analogs 
of  the  equivalent  kernels  are  described  by  the  following  recurrence 

...  iA  ,  '  1  \  '  UM.-1 

relation;  /  A  / .  \  .Oi  W 

C>.^  "  b.  Cx^  <S>  O 


'  O  £  -  W 
Q  o  •VKtfr  w»*' 

These  functions  may  be  convolved  analytically,  and  have  the  -following 
properti es: 

function  form  continuity 


^  '  Piecewise  constant 

b 


I'  ^ 

V.  !  \\ 


Piecewise  linear 


Piecewise  puadratic 


Piecewise  cubic 


etc.  . 


not  continuous 

c' 

C- 


as  c  zces-.ed  bv  the  Central  Limit  Theorem,  the  degree  to  which 
iiic’s  .  p  I.  ' .  I  .Ti  t th.?  Ga-u.ssian  r -uric  1 1  on  i.r.or-o.es  ...t'.'.  c^der. 


GC0DNE3S  OF  FIT 


The  following  table  summarizes  a  measure  of  the  degree  to  which  the 
equi.alent  kernels  of  the  successi-.e  convolution  by  bo.:car  method 
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approximate  Gaussian  functions  of  th»  m»mm  weight  and  variance.  The 
quantity  shown  is  the  rms  difference  figured  over  the  non-zero  region  of 
the  equivalent  kernel,  divided  by  the  weight  of  the  equivalent  kernel. 


boxcar  length  number  of  convolutions  res  di f f erence/wei ght 


4 

4 

4 

4 


1 

3 

4 


.  180 
.043 
.021 
.014 


3 

8 

e 

9 


1 

3 

4 


.  127 
.026 
.013 
.009 


16 
16 
1  6 
1  o 


1 


4 


.090 
.018 
.  009 
.  006 


1 


4 


.064 
.012 
.  006 
.004 


VARIArJCE  AND  WEIGHT  OF  E2U I  VALENT  KERNELS 


"ne  i  s  easily  seen  to  be  .  Since  the  equivalent  l:e>'nels 


a'"?  non-nocat  I'-e 


voe' 


The  variance  or  V3  C^^-riay  bo  directly  calculated  and  is: 

Vcir  I  b  j 

The  .ariancG  of  the  convolution  of  functions  of  this  sort  is  the  sum  of  the 
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Y^risncBS  of  thB  individusl  functions.  Thus 


Vttr  ( 


EXTENSIONS 

It  IS  sometimes  di'f-ficult  to  obtain  desired  variance  and  continuity 
characteri  sti  cs  when  dasigninig  an  algorithm  using  our  approach.  A 
simple  variation  which  allows  more  freedom  in  achieved  variance  is  to 
convolve  by  a  set  of  boMcar  functions  of  different  sizes. 

A  characteristic  of  the  bo;;car  convolution  method  described  above  is 
that  features  of  the  input  signal  or  image  drift  in  position.  This  may 
be  reduced  or  eliminated  bv  alternating  the  directions  in  which  the 
bb::car  c on'/o  1  ut  1  on  passes  are  made  (in  apolications  having  this 
*le.:ibility  in  addressing). 


VI.  APF LI  CATION  ISSUES 

Ar  important  concern  in  choosing  an  alacrithm  for  Gauissian  convolution 
1=  ^-ns-trer  a  heira'-chy  of  results  at  different  scales  is  desired.  If 
^uli  sice  'i.e.  rot  reduced)  results  are  Cosired  at  only  one  particular 
LO---.  ■.  -ra.i  s  :,^rtr.?d  .  1  ,  '  t  3  ‘  1  la  .i.orp  cpsti.  1  *■  '•apuirss 

poTp.;tation  proportional  to  t“e  leg  of  the  sice  of  the  )  ernel  edge, 
i-iherc-as  Cann/'o  recursive  fiicc^  aoproach  CCanr.y  93]  and  the  successive 
be. car  mgthed  I'je  pr-eoent  here  comp  1  e.;  1 1 i-jhich  is  independent  of 

t; e  I  e^ n el  sice. 

Uf.ich  IS  most  economical  Pep-rpH  on  the  Cipo  I  i  c  at  i  on  .  Canny's 
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recursive  filter  method  CCanny  a3D,  as  he  implemented  it,  requires  24 
multiplies  and  adds  <48  operations)  per  pixel  for  two  dimensions.  The 
method  we  present,  as  usually  used  in  four  passes,  requires  16  adds  per 
pixel  in  two  dimensions.  On  the  basis  of  number  of  operations,  our 
approach  would  seem  to  be  more  economical.  The  method  we  present  does 
re  '.re  periodic  re— scaling  to  prevent  overflow  when  faced  with  limited 
precision  integers,  large  kernel  sizes,  and  low  spatial  frequencies  in 
the  input  data.  This  can  be  economically  handled  in  most  situations 
with  a  shift  instruction,  or  a  fixed  shift  in  special  hardware.  So  16  - 
24  operations  per  pixel  is  a  more  realistic  estimate  for  a  general 
purpose  computer. 

In  applications  where  multiplication  is  suDstanti al 1 y  more  expensive 
than  addition,  the  method  we  present  would  have  some  advantage.  This 
ape:  1^53  with  some  computers  (eg.  Motorola  63000).  Adders  have  less 
r.ar'pware  ccmple.ity  than  multipliers  in  special  high-speed  processor 

1  ':‘0  1  -r-'T'entat :  f.  =  . 

(i.-i  issue  to  consider,  in  additii.-  to  number  and  tvpe  of  operations,  is 
the  addressihc  r  eau  i  r  ertien  t  s  (locality  and  sequencing).  Canny's  method 
ret-.r-'S  access  to  a  small  set  of  nearby  pi>:el5  and  previous  results. 

1  r.C£pendeh‘:  the  1  ernel  sire.  Address  sequencing  in  two  directions 

c_  1  w-  /  la  r-cqi-.reJ. 

Gur  method  accesses  data  separated  by  the  size  of  the  boxcar,  which  is 
comparable  in  sice  to  the  kernel,  in  each  dimension.  Our  method  is 
aopiicabl'^  in  situations  vu  tn  simple  sequential  addressing.  In  such  a 
sitLiaticn  storage  would  be  needed  for  n  pixels  and  n  r ows  for  a  bo>:car 
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□f  3i;e  n.  In  situations  where  more  flexibility  in  addres«ing  i 
available,  the  storage  requirement  can  be  reduced  to  2n  pixels, 
example  of  this  sort  is  a  processor  where  the  addressing  sequence  can  be 
changed  from  row  major  to  column  major-  Here,  the  convolution  may  be 
carried  out  in  one  dimension  with  one  mode  of  addressing,  then  in  the 
other  dimensio.-i  with  the  other  mode'of  addressing. 

In  contexts  where  a  full  heirarchy  of  results  is  desired,  any  of  the 
methods  discussed  may  be  considered,  since  all  (except  Canny's 
adaptation  of  :=trassen's  algorithem)  have  comparable  complexity  to 
generate  the  ne:t  member  of  the  heirarchy.  Burt’s  methods  CBurt  SOD 
L&urt  3_I  are  lent  to  powers  of  two  m  the  scale  heirarchy.  Crowley's 
method  54]  is  designed  for  the  square  root  of  two.  The  method 

p^ese'^ted  hera,  *5  well  as  5ann/'s.  could  generate  heirarchies  with 
near],'  aroicrary  collections  of  scales. 


VI  I  .  :r-=LEhEri^ATICl.i 


•  ■  e 


■  e  1  '’o.ei'onted  Gaussian  convolution  usino  successive 
ars  in  a  c  tr  ai  ght -t  or  ■••(ard  fashion  on  a  A  <;  11/75C)  in 

3.  -cc'-n  i-ately  of'  seconcs  are  required  for  a  four 
laci-,  -  on  cl  5  d cld  c  ■.  s  Ci.  ;  magus. 


convolut i on 
the  C 
pass 
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Appendix  I 

ON  implementing  atlas 


Thia  part  o{  the  report  describee  experience  with  the  first  attempt  at  implementing 
ATLAS.  It  discusses  some  of  the  basic  issues  in  dealing  with  an  assembly  system,  mecha¬ 
nisms  for  representing,  storing  and  extracting  information  concerning  constraint  generation 
and  task  specification.  It  summarises  implementation  of  a  skeleton  matcher,  and  points 
out  some  elements  of  interdependency  links  in  the  planning  system. 

Issues  concerning  implementation  of  other  planning  modules,  of  an  improved  geometric 
modelling  system  and  constraint  solver,  of  incorporating  dimensional  uncertainty  in  the 
planning  procedure  are  not  discussed.  They  form  a  majority  of  the  proposed  task  planner. 
We  need  a  careful  examination  of  these  parts  before  we  conunit  to  a  performance  level  of 
ATLAS. 

1.  Introduction 

This  report  discusses  a  preliminary  implementation  in  order  to  develop  an  architecture 
for  a  new  task  level  planning  system  called  ATLAS  (Automatic  Task  Level  Assembly 
Synthesiser)  proposed  by  Brooks  and  Los  ano- Peres  {Brooks  83] . 

Of  the  few  task  level  systems  proposed  prior  to  ATLAS,  most  concentrated  on  illus¬ 
trating  a  single  component  of  task  planning  or  presenting  the  syntax  and  semantics  of  a 
task  level  system  with  approaches  to  its  implementation.  Taylor[Thylor  76]  discussed  an 
approach  to  synthesize  sensor-based  AL  programs  from  task  level  specifications.  That  ap¬ 
proach  was  significantly  extended  by  Brooks  [Brooks  83]  to  include  not  only  forward  prop¬ 
agation  of  symbolic  constraints  but  backward  propagation  to  impose  forcing  constraints  on 
planning  variables.  In  the  process,  appropriate  sensing  is  introduced  to  alleviate  deadlock 
in  unsatisfied  constraints.  It  is  this  approach  that  underlies  much  of  ATLAS. 

Some  of  the  basic  driving  ideas  in  the  planning  process  took  shape  in  the  form  of 
mechanisms  for  extracting,  representing  and  storing  information  concerning  constraint 
generation  and  task  implementation.  They  have  been  discussed  in  detail  in  section  2. 

The  constraint  generator,  skeleton  identification,  and  task  specification  have  been 
implemented  so  far. 

This  report  also  tries  to  identify  some  elements  of  the  thread  representing  the  interde¬ 
pendency  among  various  hierarchically  abstracted  planning  steps.  Such  interdependency 
plays  the  key  role  in  exploiting  mutual  constraints  among  various  steps  to  force  a  decision 
on  planning  variables.  The  extent  of  integration  in  planning  steps  will  result  from  the  scope 
of  propagation  of  these  interdependencies  in  a  single  task  iteration  and  across  successive 
planning  iterations. 

Last  but  not  least,  the  heart  of  such  a  planning  system  is  a  constraint  solver  which  in 
addition  to  the  backtracking  mechanism  built  on  top,  determines  the  scope  of  constraint 
propagation.  Issues  relating  to  this  aspect  of  ATLAS  were  not  experimented  with  in  the 
current  effort  but  need  careful  exsimination  before  committing  to  a  performance  level  of 
ATLAS. 
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2.  Issue*  at  stake 
2.1  Assemblies 

Assemblies  consist  of  objects  whose  degrees  of  freedom  have  been  restrained  in  some 
manner  to  some  design  purpose.  Objects  are  restrained  by  interaction  of  features.  An 
assembly  is  mad*  by  a  set  of  operations  each  of  which  introduces  a  new  relationship  among 
objects. 

Objects  interact  through  their  features,  namely  surfaces,  edges  and  points.  Two  ob¬ 
jects  may  be  related  to  each  other  by  interaction  of  single  feature  elements  from  each  side. 
We  will  call  such  interactions  first  order  interactions.  Interactions  which  involve  two  fea¬ 
ture  elements,  distinct  in  at  least  one  of  the  participating  objects,  belong  to  second  order 
and  so  on.  Of  the  nine  possible  first  order  interactions,  thm  are  not  stable.  They  are 
(point, point),  (point, edge)  and  (edge,edge).  Others  are  stable.  Stable  interactions  can  be 
characterised  ^  their  connectivity. 

By  connectivity  we  mean,  the  number  of  parameters  that  need  to  be  specified  to 
describe  an  infinitesimally  small  relative  movement  of  the  two  objects.  Interactions  take 
place  over  simple  geometrical  extents  of  the  features  involved.  At  the  boundary  of  features 
involved  in  a  particular  interaction,  a  small  change  in  relative  position  may  cause  the 
interaction  to  cease.  We  will  ignore  the  possibility  that  small  relative  movement  may  end 
the  interaction. 

With  connectivity  defined  as  above,  the  first  order  stable  interactions  are  divided  into 
one  of  the  following  categories: 

1.  Lower  pair 

a.  Planar  interaction  •  with  connectivity  3. 


|»-  ^UnAT 


S*  Scsctt 
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b.  Cylindrical  interaction  •  with  connectivity  2. 

c.  Screw  interaction  -  with  connectivity  1. 

2.  Higher  pair 

a.  Point-contact  interaction  •  with  connectivity  5. 

b.  Line-contact  interaction  -  with  connectivity  4. 

Two  objects  that  share  interaction  are  related.  The  relationship  will  at  least  contain 
one  interaction  -  first  or  multiple  order.  A  relationship  can  be  categorized  by  the  residual 
degree  of  freedom  (RDOF)  of  either  object  with  respect  to  the  other.  In  a  relationship  with 
first  order  interaction,  the  RDOF  is  the  same  as  connectivity  of  the  interaction.  RDOF 
of  a  multiple  order  interaction  will  be  the  size  of  the  set  of  intersection  of  sets  of  variables 
for  each  participating  first  order  interaction,  e.g  if  the  intersection  is  null,  RDOF  is  0. 

Categorising  relationship  by  residual  freedom  is  a  common  practice  in  the  study  of 
kinematics.  In  our  case,  parts  that  participate  in  assembly  correspond  to  links  ia  a  kine¬ 
matic  chain  and  residual  freedom  between  two  parts  corresponds  to  the  kinematic  degree 
of  freedom  between  two  links. 

There  are  two  aspects  of  residual  degree  of  freedom  that  we  wilt  highlight  at  this  stage: 

-  The  position  variables  of  an  object  that  may  get  associated  with  any  uncertainty  are 

the  set  of  variables  present  in  the  residual  freedom  space. 

-  Residual  freedom  of  an  object  changes  when  it  acquires  a  non-redundant  relationship 

with  an  object  that  is  introduced  by  the  manipulator. 

The  reason  for  deviating  from  the  kinematic  division  of  pairs  will  become  obvious 
when  we  analyse  the  prismatic  pair  and  revolute  pair  in  terms  of  our  types.  It  will  also 
illustrate  the  basic  difference  in  recognising  the  pairs  at  the  level  of  geometric  elements  of 
the  two  participating  objects  referred  to  earlier  as  features,  rather  than  recognising  just 
the  two  links  involved  in  the  process. 

In  terms  of  our  division,  the  prismatic  pair  is  a  combination  of  four  planar  interactions 
between  the  participating  objects  with  one  RDOF.  The  pair  could  as  well  be  a  second  order 
interaction  containing  two  intersecting  planar  interaction.  This  configuration,  however,  will 
not  be  physically  sustainable. 

Similarly,  the  revolute  pair  can  be  achieved  in  various  ways  depending  on  the  physical 
implementation  of  the  pair.  One  of  the  implementations  has  been  shown  in  fig.  1. 

Such  feature  to  feature  representation  of  relationships  among  objects  leads  to  an  "As¬ 
sembly  Graph*  where  objects  are  represented  as  nodes  and  interactions  as  links.  The  links 
in  the  graph  are  time  tagged. 

An  Assembly  Graph  representation  of  an  alternator  from  Whitney  [Whitney  81|  has 
been  illustrated  in  fig  2.  The  assembly  graph  has  been  simplified  by  not  including  the 
detail  graph  for  bearings  which  theoretically  contain  higher  pair  interaction  between  the 
races  and  the  bearing  elements. 
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fig.  2:  alternator 


Assembly  Graphs  are  generated  from  a  specification  of  the  task  by  the  user.  An 
assembly  graph  fa^tates  inference  of  residual  freedom  of  objects  at  any  given  time  by 
recognising  only  thoee  links  which  have  been  established  at  this  point.  Therefore,  the 
uncertainties  in  position  of  an  object  which  are  a  function  of  the  residual  freedom  at  that 
instant  can  be  inferred  using  this  graph. 

Ambler  and  PopplestonefPop  80]  recognised  some  of  the  relationships  described  here 
as  ways  of  specifying  spatial  relationship  and  solved  the  problem  of  making  inference  on  the 
spati^  position  of  the  object.  In  the  process,  they  could  make  an  inference  of  the  residual 
freedom  of  an  object.  In  a  system  which  aims  at  simplifying  the  level  of  specification  of 
the  task,  the  assembly  graph  can  be  generated  by  compiling  the  task  specification.  At  the 
end  of  specification,  the  interpreter  can  return  to  the  user  to  resolve  cases  where  for  the 
given  link  constraints,  there  are  multiple  solutions  for  the  spatial  position  of  the  object  or 
there  is  no  solution  because  it  still  has  some  residual  degree  of  freedom.  Issues  at  this  level 
have  not  been  explored  any  further. 

2.2  Planning  Islands 

The  object  of  a  task  planner  is  to  generate  robot  level  program  from  a  given  user’s 
specification  of  the  task.  The  input  sequence  of  the  task  complete  /  specifics  the  sequence 
of  assembly.  The  planner  expands  the  task  into  robot  specific  motions  introaucing  sensory 
operations  to  ensure  the  success  of  the  task  under  uncertainties. 

For  example,  consider  a  simple  assembly  operation  where  a  lid  is  tightened  on  top  of 
a  box  with  four  bolts;  the  task  can  be  specified  as  follows: 

Place  LID  on  BOX  (against  (FACEO  LID)  (FACEl  BOX) 

Tighten  BOLT  I  (into  (HOLEl  BOX)  (HOLES  LID)  ) 

Tighten  BOLT2  (into  (HOLE2  BOX)  (HOLE6  LID)  ) 

Tighten  BOLT3  (into  (HOLE3  BOX)  (HOLE7  LID)  ) 

Tighten  BOLT4  (into  (HOLE4  BOX)  (HOLES  LID)  ) 

Bg.  3 

A  simplistic  approach  to  generating  a  robot  level  program  without  uncertainties  in  the 
manipulator  motion  or  part  dimensions  will  involve  making  decisions  about  the  following 
problems: 

1 .  Parts  Feeding  •  considerations  here  address  speed  and  reliability  in  acquiring  the  parts. 
Feeders  may  be  needed  for  the  BOLT,,  LID  and  BOX. 

2.  Layout  -  This  refers  to  making  decisions  about  the  initial  locations  of  the  feeders,  the 
location  where  the  assembly  will  be  carried. 

3.  Fbcturing  -  The  planner  must  determine  the  fixture  which  will  bold  the  part  for  as¬ 
sembly  with  considerations  like  reach  of  certain  features,  resistance  to  forces  exerted 
by  manipulators,  etc. 

4.  Grasping  -  The  planner  should  choose  the  grasp  points  with  considerations  of  stability 
in  hold,  reachability  of  the  features  at  the  initial  and  goal  position  etc. 
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5.  Fine  Motion  -  The  planner  muBt  decide  the  set  of  motions  that  guarantee  the  success 
of  the  task  in  terms  of  meeting  the  goal  position  specifications,  specifically,  how  the 
LID  will  be  aligned  with  the  BOX  so  that  the  holes  are  aligned,  how  the  BOLT„  will 
be  inserted  etc. 

6.  Gross  Motion  >  The  planner  should  decide  the  path  of  transfer  of  specific  objects 
without  collision. 

In  reality,  a  program  generated  with  only  these  considerations  will  fail  because  of  the 
uncertainties  in  the  manipulator  motion,  uncertainties  in  the  parts  dimensions  etc.  In  most 
cases  sensing  will  solve  the  problem  but  this  requires  that  the  planner  decide  what  sensing 
is  useful  and  at  what  stage  it  will  be  helpful.  In  fact,  dealing  with  uncertainty  permeates 
all  of  task  planning. 

Under  uncertainty,  the  robot  level  program  may  look  like  the  following: 


1.  Open  -  Fingers  to  <tindth  of  BOX  +  eps\lon> 

Move  2.  Move  to  <grasp  point  of  BOX>  via  <pathl> 

BOX  3.  Close  —  Fingers  to  <width  of  BOX  —  epsilon> 

4.  Move  to  Kassembly  approach  location>  via  <pathl> 

5.  Compliant  —  Move  along  <direction>  until  <eontact  with  Table> 

6.  Open  -  Fingers  to  < width  of  BOX  +  epsilon> 

reduce  7.  V'ision  -  Locate  <BOX>  near  <ezpected  position  of  BOX> 
unc. 

8.  Open  —  Fingers  to  Kwidth  of  LID  ■¥■  epsilon> 

Move  9.  Move  to  < grasp  point  of  LID>  via  <path3> 

LID  10.  Close  -  Fingers  to  Kwidth  of  LID  —  epsilon> 

11.  Move  to  Kapproach  position  of  LID>  via  <pathA> 

12.  Compliant  -  Move  along  <vert\cal>  until  Kcontact  with  BOX> 

13.  Open  —  Fingers  to  Kwidth  of  LID  +  epsilon> 


14.  Open  —  Fingers  to  Kwidth  of  BOLTl.HEAD  -f  epsilon> 

15.  Move  to  Kgrasp  point  of  BOLTl>  via  KpathS> 

Insert  16.  Close  —  Fingers  to  Kwidth  of  BOLTl.HEAD  —  epsilon> 
BOLTl  17.  Move  to  Kapproach  position  of  BOLTl>  via  Kpath6> 

18.  Bolt  —  In  -  Hole  kBOLT\>  kHOLES  of  LID> 

19.  Open  -  Fingers  to  Kwidth  of  BOLTl.HEAD  +  epsilon> 


<similarly  accomplish  insertion  of  all  other  Bolts> 

Although  even  this  program  is  not  guaranteed  to  succeed,  by  introducing  sensing  the 
possibility  of  success  has  been  significantly  increased. 
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The  tuk  planner  most  generate  the  sequence  of  operations  like  placing  the  BOX 
first  and  then  realising  that  the  uncertainty  in  the  position  of  the  BOX  and  the  LID  will 
the  task  of  inserting  BOLTl  impossible  because  of  likely  misalignment  in  the  BOX 
and  LID.  Therefore,  introducing  a  sensing  operation  before  the  LID  is  introduced  so  that 
reduced  uncertamty  in  BOX  will  lead  to  an  improved  nominal  goal  position  for  the  LID 
thereby,  reducing  the  possible  misalignment  of  the  two  parts. 

Many  of  the  decisions  made  in  generating  the  above  plan  will  involve  numerical  cal¬ 
culation  of  the  location  of  the  feeders,  the  location  in  the  work  space  where  the  assembly 
operation  will  be  carried  out,  the  grasp  point,  paths  for  the  transfer  of  parts  from  one 
point  to  another  etc..  In  addition,  for  each  task,  the  planner  will  have  to  make  sure  that 
the  constraints  necessary  for  carrying  out  the  present  operation  has  been  met.  e.g  •  LID 
HOLES  has  been  aligned  with  the  BOX  HOLEl  to  sufficient  accuracy  that  the  end  of  the 
bolt  can  successfully  enter  the  holes. 

Decisions  of  this  nature  have  been  extensively  discussed  in  BrooksfBrooks  82].  The 
process  of  planning  has  been  carefully  reduced  to  identifying  physical  variables,  plan  and 
uncertainty  variables.  Each  task  is  then  represented  in  terms  of  applicability  constraints 
that  need  to  be  satisfied  for  the  task  to  be  successful  and  propagation  constraints  that 
will  be  propagated  further  as  a  result  of  the  accomplishment  of  this  task.  The  constraints 
are  generated  symbolically  so  that  interaction  with  other  such  constraints  can  be  solved 
as  a  system  construnts.  Such  a  system  of  constraints  allows  miniingm  conunitment  at 
any  point  because  a  decision  is  made  only  when  forced  to.  Later  in  the  process  if  the  plan 
fails,  the  decision  can  be  backward-traced  by  dependency  analysis  to  identify  the  cause  of 
failure.  The  planner,  can  decide  whether  sensing  of  the  current  variable  that  caused  failure 
can  resolve  the  problem  or  not.  In  this  process,  a  backward  and  forward  propagation  of 
constraints  is  controlled  by  the  planner  until  a  successful  plan  has  been  synthesised  or  the 
planner  returns  with  a  reason  for  failure. 

A  system  of  constraints  allows  constraints  generated  across  various  planning  islands 
to  interact  if  they  have  variables  in  common.  Thus,  in  addition  to  generating  constraints 
properly  associated  with  uncertainties,  the  planner  must  also  identify  links  that  cause 
constraints  from  different  planning  islands  like  the  applicability  constraint  of  operation 
18  (Bolt-In-Hole)  to  appear  in  the  grasp  point  decision  for  operation  10  (grasp  for  LID). 
Depending  on  the  distance  of  the  center  of  rotation  of  the  wrist  from  HOLES  of  LID,  the 
uncertainty  in  the  location  of  HOLES  will  be  small  or  large  for  a  given  angular  uncertainty 
in  locating  the  wrist. 

The  next  section  presents  a  model  for  identifying  the  uncertainties.  Later,  we  will 
discuss  some  of  the  interdependency  links  that  allows  constraints  from  various  planning 
modules  to  interact. 

2.3  Uncertainties 

Generating  a  plan  that  will  succeed  in  spite  of  uncertainties  is  a  major  part  of  ATLAS. 
The  exact  value  of  the  uncertainties  may  not  be  known  at  the  planning  time  but  the  planner 
will  need  to  identify  the  variables  that  will  be  associated  with  any  uncertainty  as  well  as 
extract  information  about  their  possible  ranges. 
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BrooksIBrook*  82]  categorised  the  source*  of  uncertaintie*.  They  are  (1)  The  manip¬ 
ulator  (2)  the  object*  to  be  manipulated  and  (3)  introduction  of  these  objects  into  the 
work  environment.  This  categorisation  will  help  in  estimating  the  amount  of  uncertainty 
by  looking  at  the  error  characteristic  of  the  source. 

However,  these  sources  of  error  when  perceived  from  the  point  of  view  of  knowledge 
of  the  world,  collapse  into  two  parts  namely  the  positional  uncertainty  of  any  object  and 
the  dimensional  uncertainty  in  the  objects  themselves. 

At  this  point,  we  will  illustrate  the  notion  that  positional  uncertainty  is  directly  re¬ 
lated  to  the  residual  degree  of  freedom  of  the  object.  In  {x,y,s,theta,phi,psi}  representation 
of  position  of  an  object,  the  LID  kept  on  top  of  the  BOX  will  have  {x,y,theta}  associated 
with  any  uncertainty.  More  generally  speaking,  if  BOX  which  is  supporting  the  LID  has 
dimensional  uncertainty  in  the  height,  then  other  variables  {s,  phi,pai}  also  have  associ¬ 
ated  uncertainty.  However,  in  the  absence  of  any  dimensional  uncertainty,  the  variables 
associated  with  uncertainty  are  solely  determined  by  the  residual  degree  of  freedom  of  the 
object. 

Estimating  the  uncertainty  associated  with  the  position  of  an  object  which  is  placed 
in  the  workspace  will  depend  on  the  mechanism  of  introduction  like  mechanical  feeders 
or  conveyor  belts.  The  residual  degree  of  freedom  analysis  using  the  assembly  graph  of 
the  feeder  or  equivalent  representation  of  the  conveyor  can  be  used  to  find  uncertainty 
associations.  But  in  order  to  determine  the  magnitude,  the  task  planner  will  have  to  solely 
rely  on  some  a-prioxi  information  or  carry  a  perturbation  kind  of  analysis  on  the  assembly 
graph  to  determine  the  extents  of  freedom.  This  aspect  of  uncertainty  derivation  has  not 
yet  been  explored  but  it  provides  a  powerful  mechanism  that  can  be  exploited  in  a  more 
detailed  implementation. 

Analysis  of  the  uncertainty  in  the  position  of  objects  due  to  uncertainty  in  positioning 
the  manipulator  is  as  follows: 

Every  time  an  object  is  moved  in  the  workspace,  the  object’s  position  is  derived  from  a 
known  assembly  relationship  of  this  object  with  respect  to  another  object  that  has  already 
been  introduced  except  in  the  case  of  an  initial  fixture  whose  position  will  be  decided  by 
the  planner.  This  derived  position  of  the  object  with  respect  to  a  stationary  frame  is  given 
to  the  manipulator  as  the  goal  position. 

At  the  time  the  object  is  ungrasped  at  its  goal  position,  the  position  of  the  object  with 
respect  to  a  stationary  frame  of  reference  can  be  derived  either  following  the  kinematic 
chain  of  the  manipulator  or  following  the  object  chain  in  the  assembly  graph  starting  from 
some  object  whose  position  with  respect  to  the  stationary  frame  is  known  and  following 
Links  leading  to  objects  that  will  acquire  some  relationship  with  this  object.  The  two 
estimates  of  position  will  not  usually  correspond  because  of  uncertainty  in  the  manipulator 
chain  and  uncertainty  in  the  object  chain  as  well,  even  assuming  that  there  is  no  significant 
movement  in  the  object  at  the  time  it  is  ungrasped  -a  smooth  ungrasp  operation.  Following 
the  object  chain  and  analysing  the  relationships  that  this  object  acquires  when  being 
ungrasped,  the  residual  degree  of  freedom  of  this  object  can  be  ascertained.  The  object 
can  theoretically  be  present  anywhere  in  the  space  of  its  residual  degree  of  freedom.  On 
the  other  hand,  since  the  object  is  a  part  of  the  manipulator,  the  object  can  be  anywhere 
in  the  manipulator  error  ball  that  the  end  of  the  manipulator  traces  under  perturbation  of 
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all  of  its  degrees  of  freedom  with  the  carrent  nominal  position  of  iU  links  at  goal  position. 
With  the  assumption  that  the  ungrasp  operation  is  smooth,  the  set  of  feasible  physical 
positions  of  the  object  will  be  the  common  subset  of  the  set  of  feasible  positions  obtained 
by  the  two  methods. 


Manipulator  Error  Ball 


The  space  of  residual  degree  of  freedom  of  an  object  is  the  domain  of  the  residual 
freedom  variables.  However,  finding  the  manipulator  error  ball  of  the  manipulator  under 
perturbation  of  all  of  its  degrees  of  freedom  for  all  possible  link  configurations  is  virtually 
ruled  out  because  of  the  complexity.  A  simplified  model  of  the  error  characteristics  of  the 
manipulator  can  be  used  instead.  It  is  towards  this  that  we  will  focus  our  attention. 

Let  us  kinematically  divide  the  manipulator  into  two  portions,  namely  the  gripper  that 
holds  the  object  to  be  manipulated  and  the  rest  of  the  manipulator.  The  gripper  portion 
of  the  manipulator  remains  integral  with  the  object  while  the  rest  of  the  manipulator  can 
change  or^ntation  with  respect  to  the  object. 

Let  [r»^l  refer  to  the  transformation  required  for  a  vector  specified  in  frame  ’b’  to  be 
converted  into  that  of  frame  ’a’.  Then  a  set  of  transformations  that  transforms  the  object 
at  the  manipulator  end  into  the  stationary  world  co-ordinate  system  can  be  obtained  by 
following  the  kinematic  chain  of  the  manipulator. 

./ini'i*']  • 

Since  the  gripper  is  temporarily  rigidly  fixed  to  the  object  and  the  first  link  of  the 
manipulator  is  fixed  with  respect  to  the  stationary  world,  the  above  set  of  transformations 
can  be  reduced  to: 
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If  these  tnnsfonnations  refer  to  the  actual  poeitiooi,  then  we  can  decompose  them 
into  the  nominal  component  and  uncertainty  component  by  expanding  each  of  the  elements 
of  the  transformation  matrix  in  Taylor’s  series  in  terms  of  free  variables  at  this  joint  about 
nominal  values  of  these  variables. 

where  50  refers  to  the  following  expression  for  a  single  free  variable  called  ’Sfree’. 


5[r*^]  =  SSfree  *  [Ti  +  Higher  derivative  terms 

=  +  Higher  derivative  terms 

With  these  expaiuions  the  transformation  of  the  object  with  respect  to  the  stationary 
frame  following  the  kinematic  chain  of  the  manipulator  can  be  expressed  as  following: 


[7'e4|,«,ru] 


•Hsl  *  •••  *  rl  * 

+ . 

+  . 

•  ••  •  •  ••  •  ^{Ttrir-»*tJin*'n'] 

+  higher  order  terms. 


Therefore,  the  uncertainty  in  an  object’s  position  involves  all  the  terms  of  the  above 
expression  minus  the  nominal  term  which  is  the  first  term.  Hence,  the  uncertainty  is 


Position  —  AfTfi'nSJ.wcru)  •  ••  •  [1  (VnS'i’ JtnS',’- I'l  •  ••  • 

+  . 

+ . 

+  higher  order  terms. 

Using  this  model  of  the  uncertainties  introduced  by  ths  manipulator,  we  will  illustrate 
that  for  different  planning  islands  different  first  order  terms  contribute  significantly  to  the 
uncertainty  of  the  object.  With  this  assumption,  the  uncertainty  for  that  island  will  be 
modelled  to  take  care  only  of  that  term.  For  some  modules,  the  higher  order  terms  have 
been  lumped  together  to  approximate  the  uncertainties. 

The  discussion  on  links  at  the  level  of  planning  islands  contains  the  details  of  error 
modelling. 
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3.  Implementation  specific  details: 

The  ATLAS  proposal  outlined  various  planning  modules  or  islands  that  need  to  be 
implemented  for  a  full  seals  implementation  of  the  task  planner.  These  modules  are  (1) 
skeleton  matcher  (2)  constraint  propagator  (3)  fine  motion  planner  (4)  gross  motion  planner 
(S)  grasp  planner. 

Of  these,  the  skeleton  matcher  has  been  developed  successfully  with  a  limited  task 
specification  interpreter.  An  already  available  program  for  symbolic  constraint  solver  has 
been  used  to  test  the  output  from  the  skeleton  matcher.  A  parallel  development  of  grasp 
planner  took  place  and  this  module  in  conjunction  with  the  skeleton  matcher  gives  a 
complete  scope  for  developing  constraint  propagator. 

The  skeleton  matcher  treats  the  plan  steps  in  terms  of  its  input  and  its  output.  At 
each  step,  there  are  restrictions  impo^  by  the  execution  of  this  step  that  are  invariant 
of  the  specific  details.  The  skeleton  matcher  expands  each  plan  step  to  incorporate  the 
propagation  of  these  invariant  constraints  and  leaves  other  decisions  which  depend  on 
specific  detail  to  be  expanded  later  by  the  planning  module. 

A  skeleton  is  specified  by  a  geometric  description  of  objects  and  their  state  in  a  world 
and  by  two  sets  of  constraints:  a  set  of  applicability  constraints  and  a  set  of  propagation 
constraints.  The  skeleton  gets  insatiated  by  finding  a  maudi  betwe  ;  the  geometric  de¬ 
scription  of  the  object  and  the  known  world  state.The  applicability  and  the  propagation 
constraints  are  modeled  in  terms  of  variables,  which  because  of  the  geometric  matching 
get  instantiated  to  specific  values  relevant  for  the  current  world. 

In  light  of  these  steps,  we  will  begin  with  discussing  the  geometric  modeler  and  the 
task  specification  before  we  outline  the  algorithm  and  scope  of  our  skeleton  matcher. 

3.1  Geometric  modeller 

The  modelling  system  that  has  been  used  to  represent  the  objects  and  the  spatial 
configuration  of  the  objects  in  the  world  bears  a  significant  effect  on  the  types  of  real 
world  operations  that  can  be  used  to  demonstrate  the  planner. 

Primitive  objects  in  the  modelling  system  are  constructed  by  sweeping  either  a  rectan- 
gular  cross-section  or  a  circular  cross-  section  along  a  straight  line  with  constant  sweeping 
rule.  That  is,  they  are  rectangular  prisms  and  circular  cylinders.  Each  part  of  the  prim¬ 
itive  that  refers  to  any  physical  dimension  like  the  length  and  breadth  of  rectangular 
cross-section  or  radius  of  circular  cross-section  or  length  of  the  sweep,  can  be  modeled 
as  a  nominal  value  and  a  deviation  value.  These  elements  can  be  holes.  This  allows  for 
representation  of  circular  or  rectangular  recesses  in  solid  objects. 

Primitive  elements  can  be  affixed  to  each  other  by  a  set  of  transformations  that  allow 
us  to  define  a  solid  object  consisting  of  several  elements.  The  transformations,  however, 
do  not  allow  for  any  uncertainty  to  be  incorporated  as  a  part  of  modelling. 

3.2  Task  specification 

'nuk  specification  provides  flexibility  for  the  user  in  specifying  tasks.  Several  attempts 
at  this  level  have  been  made  of  which  Lieberman  and  Wesley  [Lieb  77],  Losano-Peres 
[Loxano  76]  and  Popplestone,  Ambler  and  Bellos  [Pop  80]  are  significant. 
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In  the  current  implementation  of  ATLAS,  we  have  not  concentrated  on  any  specific 
syntax  or  semantics  of  task  specification.  Of  the  many  possible  predicates  used  in  specifying 
any  assembly  operation,  two  predicates  PLACE  and  INSERT  are  most  frequently  used. 
They  have  been  implemented  with  sub-predicates  like  AGAINST  and  INTO  to  specify 
constraints  imposed  on  the  feature  elements  of  the  objects  in  question. 

For  example,  two  operations  in  our  example  assembly  in  section  2  will  be  specified  as 
following: 

1.  (Place  LID  BOX  (Against  (FACEO  LID)  (FACEl  BOX))) 

2.  (Insert  BOLTl  (Into  (HOLEl  BOX)  (HOLES  LID))) 

In  the  assembly  graph  representation,  each  operation  has  been  viewed  as  a  process 
of  introducing  some  relationship  between  objects.  Insert*  means  an  act  of  introducing 
a  cylindrical  interaction.  The  feature  elements  that  participate  in  the  interaction  are 
specified  as  arguments  of  sub-predicate  *Into'.  A  cylindrical  feature  of  t^  e  first  argument 
of  ’Insert*  BOLTl  gets  cylindrical  freedom  with  respect  to  the  cylindrical  features  of  the 
prisms  HOLEl  of  object  BOX  and  HOLES  Of  object  LID.  Other  interactions  may  also  get 
introduced  as  a  by-product  of  this  action.  We  will  talk  about  them  in  skeleton  matching. 

'Place*  in  a  similar  sense  introduces  interactions  of  types  indexed  according  to  the 
type  of  features  specified  in  the  arguments  of  the  subpredicate.  For  example,  FACEO  and 
FACEl  for  the  subpredicate  ’Against*  in  the  above  example  index  into  planar  interaction. 

An  extension  on  this  line  will  yield  a  task  specifier  which  can  coherently  map  the 
specification  into  relationships  of  the  right  kind  in  the  assembly  graph. 

3.3  Skeleton  matching 

The  process  of  skeleton  matching  can  be  divided  into  the  following  sets  of  sequential 
operations: 

1.  Inference  of  goal  position  of  the  ’primary  object*,  usually  with  respect  to  an  already 
existing  object  in  the  workspace.  The  first  object  to  be  introduced  in  the  workspace 
has  its  position  variables  associated  with  variable  names  which  will  get  instantiated 
to  specific  values  by  the  layout  iterator  part  of  skeleton  matcher. 

2.  Identification  of  applicability  constraints.  At  this  stage  some  tasks  that  will  not  suc¬ 
ceed  under  any  circumstance  are  identified.  However,  generation  of  applicability  con¬ 
straints  is  postponed  until  the  end. 

3.  Finding  out  all  ’interactions*  that  the  current  object  acquires.  In  each  task  specifica¬ 
tion,  there  is  a  primary  interaction  inferred  from  the  syntax  and  arguments  and  there 
are  other  interactions  that  get  introduced  as  side  effects  of  the  primary  operation. 
This  portion  updates  the  relationships  for  the  primary  interaction  as  well  as  other  in¬ 
teractions  in  the  ’assembly  graph*.  The  assembly  graph  s':ores  particular  information 
about  each  interaction  in  terms  of  the  description  of  prisms  and  features  participating 
in  the  relationships. 

(steps  1,2  and  3  truly  belong  to  user  interface  module.) 

i.  Identification  of  primary  skeletons  for  this  operation.  At  present,  the  library  of  skele¬ 
tons  include: 


i)  Gross  Motion 

ii)  Grasp 

iii)  Bolt  in  Hols 

iv)  Ungnsp 

v)  Vertical  align  without  sensing  (i.e.  stacking) 

vi)  Catch'sU  synthesised  fine  motion 

In  the  context  of  each  of  these  skeletons,  grasp  is  introduced  with  creation  of  variables 
representing  the  point  of  grasp  for  the  object.  The  propagation  constraints  are  introduced 
tagged  with  any  fine  motion  skeleton  like  (iii),  (v)  and  (vi).  It  is  at  these  steps  that  prop¬ 
agation  constraints  acquire  physical  meaning.  All  other  slnletons  have  nothing  associated 
with  them  at  this  stage. 

5.  Generation  of  applicability  constraints  and  propagation  constraints  which  are  posted 
with  the  corresponding  fine  motion  skeleton.  The  ’assembly  graph’  is  scanned  with 
specific  time-stamp  to  find  the  uncertainties  associated  with  each  object  in  question. 
They  help  to  establish  the  object’s  actual  position  with  respect  to  another  object  in 
the  ’assembly  graph*.  Position  evaluation  of  objects  with  respect  to  the  stationary 
frame  is  required  because  some  part  of  the  uncertainty  has  been  modeled  with  respect 
to  the  position  of  the  object  in  stationary  frame. 

6.  Updating  the  global  skeleton  graph  which  keeps  track  of  the  planning  islands  intro¬ 
duced  so  far  and  the  objects  associated  with  each  o.‘  these  islands.  If  any  constraints 
are  imposed  on  them,  they  are  also  available  in  a  form  acceptable  by  the  constraint 
solver. 

7.  Updating  the  global  logical-time  variable  to  show  completion  of  a  set  of  operations. 
Each  skeleton  is  associated  with  one  logical  time  unit.  Hence  normally,  one  object 
movement  operation  gets  incremented  by  a  unit  of  five  corresponding  to  (gross-to- 
grasp,  grasp, gross-to-goal, fine-motion, ungrasp). 

In  the  present  structure  of  the  skeleton  nmtcher,  this  module  also  acts  as  the  exec¬ 
utive  module,  accepting  the  task  specification  and  generating  a  preliminary  plan  for  the 
task.  The  constraint  propagator  will  be  invoked  by  this  module  which  in  turn  maintains 
a  generator/  iterator  relationship  with  other  modules.  Thus  constraint  propagator  will 
return  to  skeleton  matcher  only  if  backtracking  has  caused  it  to  pop  up  to  the  level  where 
a  new  skeleton  is  required.  Usually  at  this  stage  introduction  of  sensing  operations  at  a 
point  where  backtracking  identified  a  variable  causing  the  failure,  may  solve  the  problem. 
However,  i*  %his  fails  then  a  new  layout  is  generated  for  fresh  iteration. 

Thus,  the  skeleton  matcher  will  iterate  over  a  set  of  feasible  layouts  until  success  or 
exhaustion  of  all  possible  layouts  and  failing  to  come  up  with  a  satisfactory  plan. 

4.  Links  among  planning  islands 

The  ATLAS  approach  to  task  planning  is  to  first  model  all  plan  steps  at  a  broad 
level  (as  explained  in  last  section  at  skeleton  level)  and  generate  all  constrmnts  which 
are  invariant  of  successive  refinement  processes.  The  effects  of  constraints  are  propagated 
throughout  the  complete  plan.  Elach  step  is  then  refined  into  further  detaUs.  Again 
constraints  are  propagated  and  in  case  of  failure,  dependency-directed  backtracking  is 
invoked. 
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Isolation  of  dependency  links  is  a  major  source  of  imparting  knowledge  to  the  planner 
about  means  of  achieving  a  task.  A  planner  which  carries  out  plan  generation  for  each 
module  in  Isolation  obviously  has  less  chance  to  succeed  than  one  that  decides  things  in 
consultation  with  other  modules.  Usually,  each  module  will  have  specifics  to  decide  what 
can  be  divided  into  intra  and  inter-module  effect.  For  example, in  the  grasp  module,  exact 
path  of  movement  of  the  manipulator  from  approach-of-grasp-point  to  the  grasp  point  is 
an  intra-module  decision  as  long  as  the  module  propagates  the  guard  volume  to  carry  the 
operation,  but  choice  of  actual  grasp  point  is  a  inter-module  decision. 

In  addition  to  isolating  the  dependency  links  for  grasping  and  gross  motion  modules, 
we  will  present  ways  to  model  them  using  manipulator  error  characteristics  presented  In 
section  2.3. 

4.1  Grasping 

Decisions  in  the  grasping  module  are  constrained  by  the  location  and  environment 
of  the  part  at  the  initial  position  and  at  the  final  position.  These  constraints  are  intra- 
module  decisions  if  the  grasping  module  specifies  the  guard  volume  and  the  planner  can 
give  information  to  the  grasp  planner  about  orientation  of  the  part  at  the  initial  and  final 
positions.  But  these  restrictions  by  themselves  do  not  model  the  grasping  module’s  effect 
on  the  environment. 


a.E(TcGt  of  Gr.'uping  point 

For  a  inter.'ictioii 

_ fig  5 _ 


b. Approx,  of  rutn.  unc. 


Consider  the  task  in  the  assembly  example  in  section  2.2.  The  choice  of  grasp  position 
for  the  LID  in  operation  9  affects  the  success  of  the  Bolt-In-Hole  task  in  operation  18.  The 
applicability  constraint  associated  with  operation  18  specifies  that  HOLES  of  LID  and 
HOLEl  of  BOX  have  to  be  aligned  to  sufficient  extent  so  that  the  operation  of  Bolt-  -in- 
hole  can  be  successful.  If  the  wrist  of  the  manipulator  can  be  located  within  ±  0.2  degrees 
then  depending  on  the  position  of  the  grasp  which  determines  the  arm,  HOLES’s  error  ball 
will  be  different. 
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If  we  recall  the  error  characteristic  model  of  the  manipulator,  the  first  order  terms  of 
the  uncertainty  are: 


Position  =A(rtoaj.»«»Ml  •  ••  •  •  ••  • 

+ . 

+ . 

+  higher  order  terrru. 

Of  these  terms,  the  last  of  the  first  order  terms  involving  transformation  from  'grip- 
obj’  to  Unk’n’  will  contain  solely  rotational  parts.  The  manipulator  error  characteristic  is 
modeled  such  that  the  uncertainty  due  to  the  rest  of  the  terms  contributes  to  translational 
uncertainty  of  the  object's  position  and  this  term  contributes  to  the  rotational  uncertainty 
of  the  object.  This  allows  grasp  points  to  become  dependent  on  the  task’s  applicability 
constraint.  The  uncertainty  expressions  are  simplified. 

Recall  that  the  uncertainty  of  an  object  is  the  intersection  of  the  space  spanned  by 
residual  degrees  of  freedom  and  the  error  ball  of  the  manipulator.  The  rotational  part  of 
the  uncertainty  can  be  resolved  along  the  residual  freedom  variable  space.  Fig  5  contains 
illustration  for  an  object  which  gets  planar  residual  freedom.  Note  that  uncertainty  due 
to  the  rotational  term  has  been  approximated  by  a  rectangle  enclosing  the  translational 
uncertainty  with  average  rotational  error  for  the  point  of  interest  in  the  given  object. 

4.2  Gross  motion 

Decisions  in  the  gross  motion  module  belong  to  the  intra- module  category  as  long  as 
there  exists  a  path  and  propagation  of  proper  guard  volume  for  the  start  and  the  goal 
position  has  been  incorporated. 

Usually,  the  goal  position  of  a  manipulator  when  solved  using  inverse  kinematics, 
results  in  multiple  solutions.  The  choice  among  them  can  be  guided  by  considerations  for 
uncertainty  at  the  final  position. 

Considering  the  uncertainty  expression  from  2.3,  we  realize  that  the  uncertainty  at 
the  goal  position  is  a  function  of  the  nominal  values  of  link  orientations  for  the  goal  posi¬ 
tion.  The  planner  should  choose  a  configuration  that  involves  minimum  contribution  from 
most  of  the  free  variables  of  the  manipulator.  Finding  a  configuration  that  contributes 
least  to  the  uncertainty  involves  examining  effects  of  each  of  the  first  order  uncertainty 
terms  in  relation  to  the  residual  freedom  variables.  Therefore,  transformations  that  con¬ 
vert  either  the  residual  freedom  space  to  the  joint  space  or  vice-versa  are  required.  Such 
transformations  can  be  obtained  in  two  ways.  First,  by  following  the  assembly  graph  to 
the  stationary  frame  and  then  the  manipulator  chain  to  the  joint  space.  Or  second,  rec¬ 
ognising  that  the  manipulator’s  assembly  graph  and  the  'assembly  graph’  at  the  moment 
of  ungrasp  operation  will  have  the  object  as  a  common  node.  Using  the  latter  method, 
number  of  transformation  multiplications  are  reduced  considerably.  With  this  method,  the 
choice  among  multiple  positions  of  the  manip\ilator  at  the  goal  position  can  be  limited. 
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Appendix  J 

PROGRAM  POR  SIMULATION  OP  TWO-LINK  MANIPULATOR 

WITH  PLEXIBLE  TENDONS 


This  appendix  describes  the  derivation  of  the  equations  of  motion  and  the  essential 
programs  and  subprograms  used  to  simulate  the  Stanford  two-Unk  arm  with  flexible  tendon 
drive.  The  codes  themselves  are  available  on  request  as  a  separate  pamphlet. 

Program  LINKM:  Linkm  is  a  simple  test  program  which  calls  a  linearised  and  two 
noo'llnearised  equations  of  motion  subroutines  and  calculates  the  system  states,  linearized 
F,  G  and  H  matrices  (used  in  control  system  design  as  a  first  order,  linear  system  model: 
xdot  =  F  X  +  G  u,  y  =  H  x),  MIMO  transfer  function  poles  and  zeros,  and  eigenvalues 
and  eigenvectors  of  the  linearised  plant. 

Subroutine  NONLINM:  Nonllnm  contains  the  full  nonlinear  equations  of  motion  of 
the  two-link  arm  with  flexible  tendons  and  viscous  damping  in  the  drive  motors.  The 
equations  of  motion  were  derived  automatically  by  the  symbolic  manipulation  program 
MACSYMA  and  automatically  translated  into  FORTRAN  code. 

Subroutine  NONLIN:  Nonlin  contains  the  full  nonlinear  equations  of  motion  of  the 
two-link  arm  with  flexible  tendons  and  viscous  damping  in  the  drive  motors.  The  equations 
of  motion  were  derived  by  band  and  are  believed  to  contain  errors  that  the  MACSYMA 
derived  equations  do  not  have. 

Subroutine  LINEARM:  Linearm  contains  the  linearized  equations  of  motion  of  the 
two-link  arm  with  flexible  tendons  and  viscous  damping  in  the  drive  motors.  The  linearized 
equations  were  derived  automatically  using  MACSYMA. 

A  complete  printout  of  these  programs  is  available  on  request  as  a  separate  pamphlet. 
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Appendix  K 

ELECTRONIC  INTERFACE  MODULE 
FOR  A  PNEUMATIC  *PICK  AND  PLACE*  GRIPPER 


Tbc  *Oa«  Uak  Icxibk  maaipaUtof”  developed  at  the  Depattmeat  of  Aero 
aaotks  it  Aitioaaatke  aceompltibcd  tbe  fint  '^ick  aad  place”  maaeaver 
by  asiac  a  solenoid  operated  meehaakal  flipper  (Schmitt  1083). 

Beiaf  the  “tret  eat  gripper”  h  was  able  to  “pick  and  place”  a  piag-poag 
ban.  To  enable  the  *piek  aad  place*  aiaacaver  with  a  heavier  mass,  a 
paeaaaatk  gripper  was  designed. 

A  separate  experiment  was  performed  to  aMasare  the  response  time  of 
the  paenmatk  gripper  when  a  pressnre  is  applied,  aad  the  recovery  time 
of  the  gripper  when  the  piessnrc  is  removed.  Baaed  oa  the  tesaka  of  this 
prelimiaary  experimeat  a  gripper  operariag  eketroak  interface  modak  was 
developed  that  aBowa  the  “one  link  lexibk  ataaipalatot”  to  perform  the 
fastest  ”piek  aad  place”  maaeaver  for  varying  mass. 

One  of  the  poesibk  Aitnre  ases  of  thk  gripper  wiU  be  in  the  Seld  of  the 
adaptive  coatroL 


IntrodnetioB 

Th«  *pick  and  place*  maaenver  aa  perfonned  by  the  "one  link  flexible  manipulator* 
with  the  pneumatic  gripper  could  be  divided  in  aeveral  sequencee: 

1.  The  manipulator  orientation  towards  the  object  to  be  picked  up  (in  our  case  the  disc). 

2.  Gripper  actuated  and  pushed  down  into  the  disc’s  hole. 

3.  Pressure  applied  to  the  inflatable  rubber  finger. 

4.  Gripper  actuated  and  pulled  up  carrying  the  lifted  disc. 

5.  The  manipulator  orientation  towards  the  *placing*  place. 

6.  Gripper  actuated  and  pushed  down. 

7.  Pressure  released  from  the  rubber  finger. 

8.  Gripper  actuated  and  palled  up  ready  to  move  to  pick  up  a  *new*  object  (starting 
once  again  at  sequence  #1) 

The  time  needed  for  sequences  #2  and  #6  is  listed  by  the  pneumatic  valve  manufac¬ 
turers  and  is  considerably  short  (approx.  S-10  msec.) 

This  movement  is  down  oriented,  therefore  is  short  with  or  without  the  disc. 

We  performed  a  preliminary  experiment  to  determine  the  minimum  time  interval 
needed  between  sequences  #3  and  #4  and  sequences  #7  and  #8  as  well. 

According  to  the  results  of  this  preliminary  experiment  (as  described  in  section  2)  an 
electronic  command  interface  module  was  developed  and  connected  between  the  computer 
(LSI  11/23)  and  the  gripper  itself. 
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To  determine  the  time  interval  needed  for  the  rubber  finger  *to  grip*,  the  following 
meaaurement  waa  done: 

Having  the  rubber  finger  incide  the  dlekt  an  electric  command  opened  the  pneumatic 
valve  infixing  the  rubber  gripper.  The  force  ft  applied  by  a  solenoid  actuator  pressed  the 
disk  against  the  vertical  sted  wall,  keeping  it  horisontal  due  to  the  friction  between  the 
disc  and  walL  The  force  Fi  -released  a  ATt,  time  interval  after  the  pressure  was  applied 
to  the  rubber  finger.  This  ATt,  was  adjustable. 

If  AT,  was  long  enough  the  disk  remained  attached  to  the  gripper. 

If  AT,  was  too  short  the  disc  fell  down  before  the  gripper  finger  gripped  it. 

Finally,  luing  a  14  mm  diameter  rubber  finger  and  an  II  mm  diameter  hole  inside  the 
disc  are  measured  a  minimum  12S  msec  time  interval  needed  for  a  proper  operation. 

By  using  a  16  mm  diameter  rubber  finger  this  time  mterval  AT,  decreased  to  5  msec. 
The  amount  of  time  AT]  needed  to  release  the  pressure  from  the  rubber  finger  (through 
an  attached  and  electrically  operated  exhaust  valve.) 

A  two  channel  memory  oecUoecope  was  connected  as  follows: 

Channel  1  connected  and  triggered  by  the  electrical  step  command  applied  to  the 
exhaust  valve  to  release  the  pressure  from  the  gripper. 

Channel  2  connected  to  the  horisontal  base  of  the  experimental  set  up. 

The  diK  was  connected  (when  hanging  free  on  the  gripper)  to  +  5V. 

Once  the  electrical  step  command  applied,  the  pressure  was  released  and  channel  1 
triggered.  The  disc  felt  down  and  by  touching  the  base  triggered  channel  2 


2.  Tbs  preliminary  experiment 

As  mentioned  above  the  goal  of  this  preliminary  experiment  was  to  measure  two 
time  intervab.  both  time  intervals  were  crucial  for  a  fast  *pick  and  place*  maneuver 
performance. 

First,  it  is  important  to  know  the  amount  of  time  needed  for  the  rubber  finger  “to 
grip  *  the  disc  firmly  after  the  pressure  is  applied. 

This  time  is  the  minimum  necessary  to  keep  the  arm  steady  above  the  disc  after  having 
the  gripper  actuated  (pushed  down)  and  before  puUing-up  pneumatically  the  "gripper  and 
disc  system*. 

Also  important  is  to  know  the  time  interval  needed  to  release  the  pressure  from  the 
rubber  finger  to  allow  a  smooth  exit  of  the  finger  from  inside  the  disc  before  it  is  moving 
to  the  new  *pick  up*  addren. 


AT4  s  ATa  -h  ATa 

Where 

ATa  the  amount  of  time  needed  to  release  the  disc  after  the  pressure  release 
ATa  the  free  falling  time  of  the  disc. 

Finally  we  got  that  AT  m  35  msec. 


L06 


These  results  were  used  to  design  a  fast  command  interface  module  to  provide  the 
computer  control  for  the  gripper. 

S.  The  interface  eireiiit 

The  circuit  drawing  is  shown  in  Appendix  C.  The  circuit  uses  two  output  (D^andDi) 
from  the  MINC  computer,  the  software  that  operates  the  experimental  gripper  is  call^ 
■EPULSE*.  D,  connects  to  pin  A  of  the  circuit  and  Di  connects  to  pin  7. 

An  initialising  network  that  consists  on  an  R.S.F.F.  network  (IC>D  •  74132)  drives 
the  two  valves,  A  and  B.  Valve  A  pushes  down  the  gripper  and  valve  B  lifts  it.  For  that 
reason  they  are  operating  in  a  180*  phase  shift. 

Through  pin  A,  a  pulse  with  an  adjustable  width  is  provided  by  the  computer.  The 
pulse  width  will  determine  the  delay  between  the  gripper  vertical  movement  and  the  pres¬ 
sure  connection  or  release  to  or  from  the  rubber  gripper  finger.  Being  an  ON-OFF  type 
procedure,  the  pressure  connection  and  release  is  controlled  by  a  JKFF  (IC-C). 

This  JKFF  is  clocked  by  the  command  pulse  coming  through  pin  A.  The  gripper 
vertical  movement  is  controlled  by  the  computer  command  comming  through  pin  A  and 
pin  F. 


4.  Coaelnsioas 

The  gripper  has  not  been  mounted  yet.  However,  it  performed  a  functional  test 
operation  successfully.  Based  on  this  test  operation,  the  gripper  qualified  to  be  used  on 
the  *One  link  flexible  manipulator*  for  a  *pick  and  place*  maneuver. 
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Appendix  L 

DIRECT  VELOCITY  MEASUREMENT  USING  AN  OPTICAL  ENCODER 

Abetnct 

To  uUeve  better  control  of  •  mnltilink  robot  nna  it  b  neeessnry  to  mensnre 
both  iBfnUr  poeition  nnd  nte  of  eneb  Joint. 

The  ensiest  wqr  to  meMue  the  poeition  ia  to  use  n  sensor  mounted  on  the 
joint.  One  of  the  more  ncenmte  teehniqnct  to  mensue  nninlnr  position 
iBYohres  the  optical  shaft  encoder. 

UsnaOjr,  the  rate  is  measnted  bjr  nsinf  a  tachometer  mounted  on  the  joint 
or  an  inertial  type  rate  sensor  that  could  be  mounted  on  the  link  itse^  In 
the  first  case,  the  tachometer  measures  the  link’s  rate  related  to  its’  joint. 

A  rate  sensor  mounted  on  the  link  itself  measures  the  absolute  rate  of  the 
link  related  to  the  base. 

In  both  cases  the  extra  rate  seuaor  adds  extra  veisht,  extra  moment  of 
inertia,  aad  extra  cost  to  the  system. 

In  order  to  avoid  that,  «e  developed  an  interface  circuit  that  uses  the 
existinc  incremental  optical  shaft  encoder’s  output  to  provide  a  rate  me^ 
suremeat. 

The  technique  that  was  used  is  a  quantization  of  the  measurement  angle 
updating  the  data  at  a  given  time  intervaL  This  time  interval  was  selected 
to  provide  the  required  accuracy.  Reciprocal  rate  m  found  without  differ* 
entiatiag  by  measuring  the  time  for  a  givea  displacement.  Velocity  is  then 
eomput^  using  a  single  division  operation  ia  the  control  computer. 

Special  thanks  to  Mr.  Lawrence  Pfoffer  for  his  coUaboratioa  ia  developing 
a  very  versatile  aad  accurate  motion  measurement  card  based  on  a  position 
control  circuit  (developed  by  Mr.  Pfoffer)  aad  on  this  velocity  measuring 
circuit  described  herein. 

At  this  time  Stanford  University  is  checking  the  possibility  to  patent  this 
circuit. 

1.  Introduction 

The  interface  circuit  reported  here  wan  developed  an  part  of  an  ongoing  research  related 
to  the  *Two  Link  Flexible  Manipulator”  conducted  by  Professor  Robert  H.  Cannon  and 
Mr.  Michael  Hollars,  Ph.O.  candidate. 

Since  the  angular  (rate)  velocity  is  the  derivative  of  an  angle,  the  rate  is  often  a  noisy 
signal  if  differentiated  from  an  angular  measurement.  Using  the  angle  quantisation  method 
we  can  eliminate  this  problem. 

The  optical  shaft  encoder  consists  of  a  circular  glass  disc  imprinted  on  the  external 
perimeter  with  equally  divided  imprinted  rows  of  broken  concentric  arcs.  A  light  source 
(usually  a  LED)  is  assigned  to  each  row  with  a  detector  on  the  opposite  aide  of  the  glass 
disc.  The  disc  is  attached  to  the  rotating  shaft.  The  light  detector  can  be  expoeed  to  the 
light  coming  from  the  corresponding  LEO  or  covered  by  the  rotating  disc,  causing  a  series 
of  electric  pulses.  By  counting  these  pulses  we  can  determine  the  shaft  position.  Being 
a  non-contact  multitum  digital  device,  the  optical  shaft  encoder  does  not  influence  the 
motion  but  provides  a  very  convenient  output. 
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We  considered  two  main  possibilities  to  measure  the  rate  by  using  the  optical  shaft 
encoder. 

The  first  was  to  measure  how  many  encoder  count  pulses  occur  in  a  selected  time 
interval  (tinm  quantisation). 

The  second  was  to  measure  the  amount  of  time  in  an  angular  interval  defined  by  two 
consecutive  encoder  pulses  (angle  quantisation). 

In  time  quantisation,  the  time  interval  must  be  long  enough  to  accumulate  a  mean¬ 
ingful  number  of  angle  pulses;  the  one  count  uncertainty,  due  to  asynchronous  operation 
must  not  represent  too  large  a  rate  error.  This  limit  is  achievable  only  when  either  the 
rate  or  the  encoders  resolution  (counts  per  revolution)  is  high. 

In  angle  quantisation  an  accurate  angular  interval  is  given  by  one  complete  cycle  of 
a  single  encoder  channel.  (This  works  for  1  or  2  channel  encoders  equally  well).  We 
then  measure  time  by  counting  pulses  based  on  a  stable  crystal  oscillator.  We  can  then 
ensure  that  the  one  count  uncertainty  is  small  by  using  a  high  frequency  clock  with  a 
programmable  clock  divider  circuit.  This  gives  us  the  fiexibility  to  work  in  many  ranges 
of  speed  and  resolution. 

For  this  method,  the  error  induced  by  the  one  count  uncerta.aty  is  more  significant  at 
high  angular  rates.  In  this  instance,  too  few  clock  pulses  will  be  accumulated  in  the  given 
angle.  Maximum  rate  is  usually  well  known,  however,  and  the  clock  can  be  programmed 
to  a  frequency  such  that  the  masdmum  error  is  still  within  acceptable  limits. 

The  only  cost  is  the  requirement  for  a  single  digital  division  operation,  (which  could 
be  done  as  a  look-up  table  in  a  ROM).  The  key  benefit  is  that  this  reciprocal  method 
yields  greatest  resolution  at  low  speeds,  where  it  is  most  usefuL 

Furthermore,  the  control  loop  requires  a  higher  accuracy  in  the  rate  measurement  at 
low  rates,  rather  then  at  high  rates.  By  using  a  15  bit  counter  in  our  interface  circuit  and 
a  programmable  clock  oscillator,  we  succeeded  in  meeting  the  requirements  at  high  and 
low  rates. 

2.  The  Technical  Speciflcations 

According  to  the  Two  Link  Arm*  system  design,  the  maximum  expected  rate  was 
600*/5ec  and  the  minimum  rate  .0S*/see.  The  interface  circuit  described  here  was  developed 
according  to  these  specifications  and  according  to  the  encoder’s  specification  primarily 
imposed  by  the  position  measurement  requirements. 

The  minimum  and  maximum  limits  of  the  rate  measurement  could  be  easily  shifted 
in  both  directions  by  adjusting  the  clock  frequency  used  inside  the  interface  circuit. 

This  circuit  is  designed  to  interface  with  two  most  popular  shaft  encoder  outputs: 
square  wave  output  (TTL  level)  or  line  driver  output.  It  is  also  very  easy  to  modify  the 
circuit  to  interface  with  any  other  encoder  outputs. 

The  output  is  a  tri-state  output  connected  to  a  digital  I/O  card  for  the  computer 
(PDF  11/24). 
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S.  Til*  Velocity  Mcaaoriag  Circuit 

5.1.  GcBorol 

Having  thie  velocity  measuring  circuit  developed  we  decided  to  design  a  complete 
motion  measurement  ca^  included  also  a  position  measuring  circuit  (developed  by  Mr. 
Lawrence  Pfeifer). 

This  card  circuit  drawing  is  shown  in  Appendix  A. 

5.2.  Circuit  Block  Diagram 


Figure  1.  Interface  circuit  block  diagram. 


5.3.  Circuit  Description 

S.S.l.  The  Clock  and  the  Programmable  Divider 

These  two  blocks  are  included  in  a  SARONDC  8640  chip  (IC*7A).  The  logic  con- 
hguration  at  its  control  pins  will  determine  the  divided  frequency  to  be  used  for  time 
measurement  in  an  angle  interval. 

5.5.3.  The  Encoder  Pulses 

The  encoder’s  output  is  buffered  either  by  a  line  receiver  (in  our  case  I.C.9AIC-9A  DS 
26LS32  for  our  Teledyne  Gurley  encoders)  or  a  Schmitt  inverter  (IC>9B-74LS14)  triggered 
by  the  clock’s  basic  undivided  frequency  latches  the  encoder  output  triggering  the  timing 
logic  and  reset  logic  as  well  (IC-6C,  IC-7C,  IC-7D,  IC*SC) 
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5.3.3.  The  Reset/Tlmlng  Logie 

The  ant  one  shot  of  IC-6  is  triggered  st  pin  2  by  the  latched  encoder  pulse’s  up-going 
edge.  Its  Q  output  (pin  4)  closes  temporarily  the  ANDgate  (IC-7D  pin  2)  blocking  the 
clock  pulses  coming  IC-7A  pin  7  for  approximately  50  nsec.  Meanwhile,  the  down¬ 
going  pulse  at  pin  4  of  IC-6C  triggers  throu^  pin  12  of  IC-7D  the  drst  one  shot  of  IC-5C. 
Its  output  clocb  after  approximately  SO  nsec  (at  the  up-going  edge  of  ^  at  pin  12  IC-5C) 
the  IC-2C  and  IC-4C  buffers  and  latches  their  outputs  (the  actual  state  of  the  counter 
logic  output,  which  is  stable  having  the  clock  pulses  blocked  previously). 

At  this  time  the  second  one  shot  of  IC-5C  is  triggered  and  its  output  ^  at  pin  4 
IC-5C  blocks  for  50  nsec  the  unsynchronised  “computer  ready*  signal  (coming  from  the 
computer)  that  assures  a  stable  data  at  the  second  final  latch  outputs  (IClC  and  IC3C) 
when  the  computer  will  read  it. 

The  second  one  shot  of  IC-6C  is  triggered  to  cause  a  reset  to  the  counters  after  the 
latching  procedure  is  accomplished.  These  delays  described  above  are  short  enough  not  to 
influence  the  data  and  set  to  operate  in  the  right  timing. 

5.3.4.  The  Coonter  Logie 

The  counter  logic  consists  of  4  cascace  connected  asynchronous  counters  (IC-lD,  IC- 
2D,  IC-3D  and  IC-4D).  A  carry  signal  (pin  12-IC-lD)  is  used  ;o  reset  through  IC-7C  the 
counters  if  they  overflow. 

Actually,  the  counters  overflow  if  the  velocity  is  under  the  lower  selected  limit.  This 
limit  is  always  the  lower  detectable  velocity  required  by  the  control  system.  Below  this 
limit  the  velocity  is  considered  sero. 

Only  IS  bits  of  the  counter  logic  are  used  as  data  for  the  velocity  magnitude.  One 
input  to  the  buffer  logic  and  latching  logic  is  used  to  provide  the  sign  information,  coming 
from  pin  8  of  IC-5A. 

The  encoder  has  2  channels  with  90*  phase  shift  between  them  (a  quadrature  output). 
The  sign  logic  identifies  if  channel  A  leads  channel  B  or  channel  B  leads  channel  A.  In  one 
case  we  are  dealing  with  a  positive  velocity,  in  the  other  case  with  a  negative  one. 

3.3.5.  The  Buffer  Logie 

As  mentioned  in  3.3.4,  IC-2C  and  IC-4C  are  bit  buffer/latch  networks  (74LS374). 
They  are  buffering  the  counter  logic  from  the  latching  logic  providing  stable  data  during 
the  latching  to  the  computer  I/O  card. 

S.S.O.  The  Latching  Logie 

The  latching  logic  (IC-IC  and  IC-3C)  includes  two  74LS374  chip.  It  latches  the  stable 
updated  data  to  the  computer  I/O  card. 

3.3.7.  The  Pooition  Measuring  Circuit 

The  position  circuit  is  almost  totally  separated  from  the  velocity  measuring  circuit, 
except  that  they  are  showing  the  encoder  outputs  the  clock  chip  and  the  same  bus  to  the 
computer  I/O  teard  sharing. 
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